-- Logs begin at Mon 2022-06-27 13:59:42 UTC, end at Mon 2022-06-27 15:22:22 UTC. -- Jun 27 14:47:02.957822 dv-cinder-797608-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 14:47:02.966772 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 14:47:02.968747 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 14:47:02 2022] *** Jun 27 14:47:02.968747 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 14:47:02.968747 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 14:47:02.968747 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: nodename: dv-cinder-797608-35-iscsi Jun 27 14:47:02.968747 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: machine: x86_64 Jun 27 14:47:02.968747 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: clock source: unix Jun 27 14:47:02.968747 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: pcre jit disabled Jun 27 14:47:02.968747 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: detected number of CPU cores: 4 Jun 27 14:47:02.968747 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: current working directory: / Jun 27 14:47:02.969400 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: detected binary path: /usr/bin/uwsgi-core Jun 27 14:47:02.969400 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: your processes number limit is 47680 Jun 27 14:47:02.969400 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: your memory page size is 4096 bytes Jun 27 14:47:02.969400 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: detected max file descriptor number: 2048 Jun 27 14:47:02.969400 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: lock engine: pthread robust mutexes Jun 27 14:47:02.969400 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: thunder lock: enabled Jun 27 14:47:02.969400 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 14:47:02.969400 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 14:47:03.013166 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: Python main interpreter initialized at 0x5643cf7a29c0 Jun 27 14:47:03.013166 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: python threads support enabled Jun 27 14:47:03.013166 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: your server socket listen backlog is limited to 100 connections Jun 27 14:47:03.013166 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: your mercy for graceful operations on workers is 90 seconds Jun 27 14:47:03.013513 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 14:47:03.013590 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: *** Operational MODE: preforking *** Jun 27 14:47:03.013820 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: *** uWSGI is running in multiple interpreter mode *** Jun 27 14:47:03.013820 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: spawned uWSGI master process (pid: 115163) Jun 27 14:47:03.014010 dv-cinder-797608-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 14:47:03.020670 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: spawned uWSGI worker 1 (pid: 115164, cores: 1) Jun 27 14:47:03.020670 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: spawned uWSGI worker 2 (pid: 115165, cores: 1) Jun 27 14:47:03.020670 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 14:47:03.668276 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 14:47:03.670936 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 14:47:04.786258 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:47:04.786258 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: from cryptography.utils import int_from_bytes Jun 27 14:47:04.786862 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:47:04.786862 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: from cryptography.utils import int_from_bytes Jun 27 14:47:04.787900 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:47:04.787900 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: from cryptography.utils import int_from_bytes Jun 27 14:47:04.788351 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:47:04.788351 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: from cryptography.utils import int_from_bytes Jun 27 14:47:07.279014 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 14:47:07.279570 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 14:47:07.279765 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 14:47:07.280114 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 14:47:07.280367 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 14:47:07.280769 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.281111 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.281408 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.281632 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 14:47:07.281990 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.282090 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 14:47:07.282170 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.282332 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.282493 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 14:47:07.282651 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.282751 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 14:47:07.282960 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.283048 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 14:47:07.283281 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.283375 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.283582 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.283716 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.284032 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.284118 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.284348 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.284434 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-35-iscsi {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.284685 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.284807 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.284992 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.285093 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.285297 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.285387 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.285609 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.285709 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.285907 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.286007 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.286175 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.286263 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.286489 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.286590 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.286814 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-35-iscsi {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.286990 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.287136 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.287430 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.287539 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.287730 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.287834 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.288034 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.288126 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.288335 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.288425 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.288666 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.288777 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.288975 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.289067 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.289287 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.289472 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.289577 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.289781 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.289895 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.290084 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.290182 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.290390 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.290572 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-35-iscsi {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.290718 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.290882 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.291025 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.291188 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.291330 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.291496 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.291642 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.291898 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.291997 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.292201 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.292286 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.292501 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.292697 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.292838 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.292926 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-35-iscsi {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.293155 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.293250 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.293455 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.293541 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.293774 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.293867 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.294087 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.294229 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.294399 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.294537 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.294711 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.294842 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.295008 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.295157 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.295309 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.295488 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.295613 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.295794 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.295924 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.296118 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.296207 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.296434 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.296520 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.296763 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.296871 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.297067 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.297154 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.297370 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.297454 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.297673 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.297766 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.297982 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.298075 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.298228 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.298314 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.298472 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.298587 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.298781 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.298871 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.299113 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.299200 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.299419 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.299650 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.299741 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.299982 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.300087 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.300293 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.300387 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.300591 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.300690 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.300883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.300968 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.301134 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.301222 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.301452 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.301543 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.301770 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.301868 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.302077 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.302163 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.302384 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.302470 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.302687 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.302791 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.302987 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.303075 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.303297 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.303393 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.303601 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.303696 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.303900 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.303985 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.304201 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.304292 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.304517 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.304611 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.304844 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.304940 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.305156 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.305241 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.305462 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.305554 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.305761 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.305853 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.306061 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.306147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.306359 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.306446 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.306673 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.306759 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.306998 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.307089 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.307300 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.307389 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.307544 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.307630 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.307839 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.307925 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.308137 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.308224 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.308448 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.308539 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.308770 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.308870 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.309072 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.309168 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.309371 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.309457 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.309665 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.309758 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.309965 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.310051 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.310238 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.310321 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.310537 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.310632 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.310839 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.310931 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.311135 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.311218 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.311431 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.311567 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.311729 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.311821 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.312028 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.312120 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.312322 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.312423 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.312626 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.312808 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.312951 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.313045 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.313250 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.313342 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.313556 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.313648 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.313854 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.313952 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.314153 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.314250 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.314454 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.314539 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.315274 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.315371 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.315576 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.315811 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.315897 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.316144 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.316267 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.316457 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.316550 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.316789 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.316876 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.317091 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.317176 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.317390 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.317491 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.317696 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.317797 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.317987 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.318072 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.318284 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.318377 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.318592 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.318677 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.318891 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.318983 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.319187 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.319289 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.319483 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.319573 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.319778 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.319862 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.320070 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.320168 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.320364 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.320449 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.320664 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.320752 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.320978 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.321073 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.321272 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.321359 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.321855 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.321952 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.322160 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.322247 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.322462 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.322548 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.322760 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.322882 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.323082 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.323168 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.323348 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.323433 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.323654 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.323809 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.323955 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.324042 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.324313 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.324405 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.324623 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.324775 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.324964 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.325050 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.325284 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.325377 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.325593 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.325688 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.325898 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.325982 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.326199 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.326282 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.326515 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.326611 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:47:07.326819 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.326913 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.327123 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.327209 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.327426 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.327519 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.327744 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.327837 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.328062 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.328196 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.328374 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.328462 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.328703 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.328809 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.329014 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.329100 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.329325 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.329419 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.329627 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.329736 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.329940 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.330037 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.330261 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.330475 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.331147 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.331242 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.331461 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.331568 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.331789 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.331887 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.332122 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.332215 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.332431 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.332524 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.332772 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.332870 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.333090 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.333184 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.333399 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.333493 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.333705 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.333791 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.334009 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.334095 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.334326 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.334423 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.334648 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.334737 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.334953 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.335039 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.335266 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.335360 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.335572 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.335657 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.335878 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.335964 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.336181 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.336275 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.336486 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.336572 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.336817 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.336905 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.337147 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.337251 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.337458 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.337545 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.337773 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.337859 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.338079 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.338174 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.338388 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.338474 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.338694 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.338790 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.338999 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.339086 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.339305 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.339390 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.339601 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.339685 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.339900 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.339986 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.340198 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.340285 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.340501 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.340586 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.340826 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.340922 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.341143 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.341230 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.341456 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.341548 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.341755 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.341841 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.342064 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.342149 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.342366 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.342461 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.342668 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.342753 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.342971 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.343094 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.343273 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.343369 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.343570 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.343655 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.343874 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.344180 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.344275 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.344478 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.344563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.344817 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.344906 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.345122 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.345220 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.345424 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.345511 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.345735 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.345835 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.346081 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.346299 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.346390 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.346469 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.346681 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.346770 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.346985 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.347072 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.347291 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.347377 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.347597 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.347684 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.347905 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.348000 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.348221 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.348307 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.348529 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.348616 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.348860 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.348949 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.349180 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.349272 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.349485 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.349581 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.349790 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.349875 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.350097 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.350189 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.350409 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.350504 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.350720 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.350809 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.351019 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.351104 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.351322 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.351420 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.351619 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.351706 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.351916 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.352002 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.352213 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.352307 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.352514 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.352600 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.352837 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.352934 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.353173 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.353279 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.353427 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.353513 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.353722 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.353808 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.354020 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.354107 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.354332 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.354418 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.354632 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.354718 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.354931 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.355019 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.355273 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.355366 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.355523 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.355616 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.355822 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.355908 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.356123 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.356216 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.356425 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.356519 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.356747 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.356838 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.357049 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.357150 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.357369 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.357464 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.357676 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.357762 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.357978 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.358071 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.358278 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.358377 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.358579 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.358665 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.358882 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.358966 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.359186 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.359281 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.359499 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.359585 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.359802 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.359888 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.360117 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.360211 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.360422 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.360514 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.360761 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.360849 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.361068 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.361156 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.361376 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.361473 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.362236 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.362338 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.362543 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.362640 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.362879 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.362965 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.363284 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.363383 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.363516 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.363604 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.363832 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.363919 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.364133 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.364226 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.364440 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.364527 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.364767 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.364858 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.365072 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.365170 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.365376 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.365463 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.365680 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.365772 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.365992 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.366086 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.366312 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.366407 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.366605 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.366698 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.366908 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.367007 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.367223 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.367339 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.367526 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.367662 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.367838 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.367975 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.368141 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.368288 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.368448 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.368599 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.368791 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.368943 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.369119 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.369263 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.369423 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.369576 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.369727 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.369896 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.370042 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.370205 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.370345 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.370528 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.370649 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.370838 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.370953 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.371157 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.371242 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.371462 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.371557 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.371776 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.371862 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.372103 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.372188 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.372412 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.372505 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.372747 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.372849 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.373049 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.373135 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.373388 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.373486 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.373658 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.373751 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.373959 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.374052 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.374258 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.374345 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.374562 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.374698 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.374864 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.374949 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.375167 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.375254 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.375478 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.375571 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.375788 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.375874 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.376085 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.376171 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.376383 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.376469 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.376736 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.376837 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.377028 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.377125 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.377888 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.377986 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.378198 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.378337 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.378511 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.378650 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.378831 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.378990 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.379141 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.379297 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.379464 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.379598 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.379786 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.379910 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.380092 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.380225 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.380398 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.380528 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.380746 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.380847 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.381059 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.381146 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.381364 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.381451 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.381668 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.381760 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.381972 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.382065 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.382313 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.382399 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.382621 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.382706 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.382925 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.383012 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.383229 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.383323 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.383534 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.383632 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.383841 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.383928 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.384140 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.384224 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.384444 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.384537 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.384771 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.384872 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.385073 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.385159 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.385379 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.385474 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.385684 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.385769 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.385996 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.386239 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.386333 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.386566 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.386654 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.386877 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.386963 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.387190 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.387281 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.387500 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.387587 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.387810 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.387897 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.388119 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.388222 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.388423 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.388517 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.388760 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.388849 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.389078 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.389175 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.389385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.389639 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.389727 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.389970 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.390056 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.390274 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.390370 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.390575 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.390663 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.390874 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.390961 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.391171 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.391266 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.391474 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.391570 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.391772 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.391865 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.392071 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.392166 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.392369 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.392464 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.392687 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.392777 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.393094 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.393191 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.393401 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.393496 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.393704 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.393792 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.394007 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.394094 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.394318 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.394406 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.394624 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.394717 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.394931 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.395016 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.395232 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.395326 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.395532 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.395618 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.395836 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.395934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.396142 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.396229 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.396455 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.396540 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.396785 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.396889 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.397099 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.397186 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.397403 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.397491 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.397706 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.397800 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.398018 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.398157 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.398320 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.398406 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.398620 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.398707 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.398919 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.399006 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.399221 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.399307 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.399523 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.399612 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.399820 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.399906 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.400122 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.400215 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.400425 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.400519 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.400751 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.400841 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.401056 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.401142 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.401354 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.401449 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.401654 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.401747 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.401952 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.402046 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.402262 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.402348 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.402567 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.402652 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.402865 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.402959 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.403162 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.403248 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.403465 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.403549 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.403846 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.403946 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.404062 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.404139 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.404364 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.404452 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.404677 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.404778 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.404989 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.405074 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.405286 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.405371 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.405585 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.405678 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.405881 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.405967 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.406182 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.406266 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.406482 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.406581 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.406781 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.406867 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.407084 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.407169 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.407386 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.407473 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.407683 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.407768 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.407980 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.408065 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.408287 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.408374 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.408668 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.408769 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.409025 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.409137 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.409277 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.409363 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.409585 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.409671 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.409894 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.409987 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.410191 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.410278 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.410496 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.410583 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.410797 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.410892 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.411097 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.411190 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.411397 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.411483 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.411700 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.411838 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.411999 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.412086 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.412297 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.412383 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.412596 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.412714 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.412933 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.413019 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.413231 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.413316 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.413538 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.413624 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.413840 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.414049 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.414147 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.414228 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.414426 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.414514 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.414722 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.414809 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.415030 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.415122 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.415335 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.415423 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.415642 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.415728 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.415949 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.416043 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.416254 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.416341 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.416557 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.416688 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.416885 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.416981 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.417191 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.417277 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.417493 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.417581 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.417789 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.417883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.418088 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.418179 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.418396 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.418488 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.418699 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.418795 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.418995 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.419081 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.419293 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.419378 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.419606 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.419693 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.419909 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.419996 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.420212 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.420298 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.420525 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.420620 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.420864 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.420953 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.421167 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.421260 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.421466 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.421552 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.421768 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.421853 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.422072 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.422159 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.422373 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.422465 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.422673 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.422758 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.422975 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.423069 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.423278 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.423365 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.423584 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.423676 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.423886 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.423979 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.424782 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.424996 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.425107 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.425232 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.425356 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.425452 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.425664 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.425757 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.425973 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.426059 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.426278 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.426372 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.426586 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.426673 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.426889 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.426982 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.427189 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.427285 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.427491 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.427584 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.427790 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.427930 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.428097 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.428181 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.428396 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.428496 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.428719 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.428848 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.429033 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.429112 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.429340 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.429427 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.429647 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.429739 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.429969 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.430056 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.430276 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.430362 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.430577 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.430662 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.430882 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.430967 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.431181 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.431273 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.431489 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.431584 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.431793 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.431879 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.432164 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.432248 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.432470 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.432565 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.432794 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.432881 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.433095 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.433181 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.433398 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.433496 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.433713 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.433797 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.434011 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.434134 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.434312 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.434407 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.434613 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.434714 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.434931 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.435029 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.435228 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.435316 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.435540 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.435626 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.435906 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.435990 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.436210 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.436297 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.436514 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.436599 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.436845 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.436955 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.437167 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.437263 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.437470 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.437595 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.437772 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.437866 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.438074 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.438168 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.438396 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.438498 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.438706 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.438819 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.439023 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.439109 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.439327 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.439419 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.439645 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.440320 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.440598 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.440746 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.440930 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.441040 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.441242 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.441344 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.441544 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.441644 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.441861 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.441956 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.442179 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.442266 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.442487 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.442582 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.442803 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.442890 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.443158 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.443251 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.443503 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.443603 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.443807 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.443901 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.444125 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.444252 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.444432 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.444527 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.444763 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.444852 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.445069 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.445169 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.445374 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.445462 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.445676 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.445771 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.445978 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.446072 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.446295 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.446382 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.446864 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.446977 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.447172 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.447300 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.447477 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.447610 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.447782 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.447932 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.448084 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.448260 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.448385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.448566 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.448774 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.448879 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.449020 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.449193 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.449337 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.449498 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.449645 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.449805 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.449963 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.450126 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.450280 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.450432 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.450582 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.450743 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.450898 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.451053 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.451204 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.451362 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.451503 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.451667 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.451803 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.451993 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.452086 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.452317 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.452424 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.452622 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.452741 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.452965 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.453053 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.453279 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.453365 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.453600 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.453696 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.453920 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.454007 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.454226 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.454352 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.454546 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.454647 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.454859 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.454946 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.455165 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.455263 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.455500 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.455597 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.455807 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.455894 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.456109 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.456193 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.456417 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.456507 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.456741 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.456844 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.457044 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.457131 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.457344 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.457431 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.457649 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.457737 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.457948 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.458044 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.458246 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.458333 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.458545 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.458630 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.458871 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.458982 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.459170 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.459257 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.459485 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.459571 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.459789 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.459889 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.460089 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.460183 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.460389 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.460475 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.460706 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.460810 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.461012 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.461098 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.461322 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.461410 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.461622 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.461718 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.461926 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.462020 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.462228 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.462315 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.462547 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.462635 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.462848 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.462934 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.463165 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.463250 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.463472 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.463560 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.463776 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.463862 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.464080 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.464167 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.464381 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.464513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.464706 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.464808 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.465019 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.465114 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.465332 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.465430 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.465634 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.465722 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.465944 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.466044 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.466253 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.466341 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.466562 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.466649 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.466883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.467073 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.467200 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.467399 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.467514 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.467709 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.467828 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.468021 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.468204 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.468328 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.468533 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.468704 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.468871 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.469020 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.469186 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.469280 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.469495 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.469582 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.469809 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.469897 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.470119 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.470215 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.470433 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.470526 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.470746 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.470971 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.471125 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.471487 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.471581 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.471826 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.471921 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.472145 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.472233 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.472462 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.472557 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.472802 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.472892 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.473119 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.473206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.473433 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.473523 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.473738 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.473825 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.474046 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.474138 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.474353 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.474450 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.474663 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.474753 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.474967 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.475062 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.475270 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.475436 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.475575 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.475664 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.475880 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.475967 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.476184 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.476280 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.476487 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.476574 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.476818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.476909 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.477128 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.477224 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.477444 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.477531 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.477770 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.477864 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.478081 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.478168 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.478387 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.478472 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.478698 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.478793 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.479007 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.479146 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.479315 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.479514 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.479636 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.479824 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.479912 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.480149 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.480235 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.480468 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.480555 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.480814 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.480905 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.481126 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.481212 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.481438 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.481524 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.481762 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.481851 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.482062 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.482155 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.482364 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.482522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.482669 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.482756 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.482972 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.483066 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.483269 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.483487 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.483575 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.483804 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.483892 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.484134 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.484221 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.484457 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.484544 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.484783 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.484883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.485113 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.485307 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.485432 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.485646 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.485761 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.485957 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.486068 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.486277 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.486364 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.487113 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.487248 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.487529 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.487813 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.487917 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.488149 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.488234 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.488452 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.488540 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.488780 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.488885 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.489100 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.489225 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.489412 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.489500 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.489713 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.489812 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.490013 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.490253 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.490347 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.490599 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.490694 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.490895 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.490980 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.491200 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.491287 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.491498 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.491596 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.491817 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.491904 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.492118 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.492205 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.492418 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.492517 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.492747 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.492836 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.493045 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.493131 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.493345 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.493448 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.493647 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.493735 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.493945 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.494032 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.494244 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.494339 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.494551 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.494644 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.494850 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.494939 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.495154 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.495242 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.495453 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.495540 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.495757 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.495842 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.496053 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.496140 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.496356 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.496449 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.496686 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.496775 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.496995 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.497084 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.497305 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.497393 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.497603 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.497702 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.497904 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.497997 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.498207 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.498292 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.498507 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.498602 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.498816 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.498901 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.499119 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.499203 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.499429 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.499527 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.499733 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.499819 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.500042 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.500261 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.500348 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.500592 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.500723 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.500936 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.501024 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.501266 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.501369 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.501592 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.501679 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.501895 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.501981 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.502214 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.502855 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.503042 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.503130 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.503362 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.503500 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.503670 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.503819 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.503977 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.504132 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.504281 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.504478 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.504574 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.504820 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.504910 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.505215 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.505362 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.505521 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.505698 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.505826 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.506022 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.506129 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.506357 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.506444 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.506689 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.506777 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.506998 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.507085 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.507305 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.507393 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.507609 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.507696 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.507932 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.508019 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.508244 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.508378 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.508554 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.508680 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.508887 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.508986 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.509200 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.509297 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.509505 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.509600 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.509811 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.509897 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.510116 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.510212 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.510420 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.510508 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.510725 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.510810 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.511034 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.511122 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.511342 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.511428 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.511641 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.511726 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.511948 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.512035 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.512260 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.512347 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.512598 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.512702 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.512940 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.513038 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.513256 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.513343 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.513571 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.513665 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.513887 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.513972 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.514191 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.514277 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.514499 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.514593 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.514803 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.514889 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.515110 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.515195 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.515430 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.515526 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.515759 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.515844 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.516073 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.516158 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.516376 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.516468 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.516696 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.516827 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.516998 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.517142 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.517303 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.517461 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.517618 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.517782 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.517956 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.518246 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.518389 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.518650 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.518778 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.518954 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.519350 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.519436 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.519836 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.519925 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.520174 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.520262 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.520484 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.520579 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.520820 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.520909 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.521123 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.521209 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.521423 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.521523 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.521724 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.521812 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.522025 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.522112 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.522325 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.522426 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.522625 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.522713 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.522929 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.523015 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.523228 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.523446 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.523533 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.523773 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.523861 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.524084 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.524180 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.524380 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.524465 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.524713 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.524804 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.525023 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.525126 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.525337 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.525425 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.525644 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.525742 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.525946 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.526045 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.526255 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.526340 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.526555 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.526653 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.526858 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.526945 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.527162 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.527249 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.527468 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.527555 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.527769 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.527868 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.528070 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.528156 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.528380 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.528467 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.528703 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.528792 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.529009 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.529095 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.529312 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.529398 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.529616 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.529719 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.529920 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.530005 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.530241 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.530335 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.530561 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.530647 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.530862 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.530948 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.531182 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.531277 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.531493 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.531580 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.531806 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.531892 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.532115 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.532213 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.532416 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.532508 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.532763 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.532864 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.533072 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.533161 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.533376 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.533498 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.533737 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.533838 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.534044 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.534246 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.534340 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.534570 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.534658 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.534887 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.534983 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.535209 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.535296 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.535523 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.535611 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.535837 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.535933 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.536166 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.536253 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.536487 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.536579 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.536818 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.536908 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.537147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.537234 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.537467 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.537555 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.537788 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.537883 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.538098 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.538183 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.538407 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.538496 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.538708 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.538844 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.538949 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 14:47:07.539037 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.539330 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.539647 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.539961 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.540272 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.540589 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.540933 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.541262 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.541590 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.541900 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.542227 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.542554 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.542902 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.543219 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.543563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.543890 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.544205 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.544516 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.544852 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:47:07.545096 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 14:47:07.693201 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO dbcounter [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Registered counter for database nova_api Jun 27 14:47:07.700406 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO dbcounter [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Registered counter for database nova_api Jun 27 14:47:07.714331 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_db.sqlalchemy.engines [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:47:07.720787 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writer thread running {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:47:07.721629 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG oslo_db.sqlalchemy.engines [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:47:07.728146 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writer thread running {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:47:07.777982 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.context [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d98c4119-3b5c-4544-98c3-1189517bc4f8(cell1) {{(pid=115164) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 14:47:07.781914 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:47:07.784041 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:47:07.784991 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:47:07.786011 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.context [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d98c4119-3b5c-4544-98c3-1189517bc4f8(cell1) {{(pid=115165) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 14:47:07.786929 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:47:07.788906 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO dbcounter [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Registered counter for database nova_cell0 Jun 27 14:47:07.789931 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG oslo_concurrency.lockutils [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:47:07.791498 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG oslo_concurrency.lockutils [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:47:07.792285 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG oslo_concurrency.lockutils [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:47:07.792887 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO dbcounter [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Registered counter for database nova_cell1 Jun 27 14:47:07.794243 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG oslo_concurrency.lockutils [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:47:07.796208 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO dbcounter [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Registered counter for database nova_cell0 Jun 27 14:47:07.800923 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_db.sqlalchemy.engines [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:47:07.801090 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO dbcounter [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Registered counter for database nova_cell1 Jun 27 14:47:07.803051 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_db.sqlalchemy.engines [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:47:07.808012 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writer thread running {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:47:07.808168 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG oslo_db.sqlalchemy.engines [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:47:07.809472 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG oslo_db.sqlalchemy.engines [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:47:07.810702 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writer thread running {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:47:07.815825 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writer thread running {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:47:07.821487 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writer thread running {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:47:07.955290 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO dbcounter [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Registered counter for database nova_cell0 Jun 27 14:47:07.962387 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_db.sqlalchemy.engines [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:47:07.965624 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO dbcounter [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Registered counter for database nova_cell0 Jun 27 14:47:07.966615 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writer thread running {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:47:07.972241 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG oslo_db.sqlalchemy.engines [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:47:07.976595 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writer thread running {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:47:08.399189 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: WARNING keystonemiddleware.auth_token [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 14:47:08.406427 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: WARNING keystonemiddleware.auth_token [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 14:47:08.416566 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: WARNING keystonemiddleware.auth_token [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 14:47:08.423706 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: WARNING keystonemiddleware.auth_token [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 14:47:08.747196 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: WARNING keystonemiddleware.auth_token [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 14:47:08.753290 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: WARNING keystonemiddleware.auth_token [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 14:47:08.758599 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643cf7a29c0 pid: 115164 (default app) Jun 27 14:47:08.760688 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:47:08.761867 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001751 Jun 27 14:47:08.762284 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Mon Jun 27 14:47:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:47:08.765141 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: WARNING keystonemiddleware.auth_token [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 14:47:08.771366 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: WARNING keystonemiddleware.auth_token [None req-5c32398b-44d2-4999-bb93-04f3843dbcd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 14:47:08.776629 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643cf7a29c0 pid: 115165 (default app) Jun 27 14:48:26.723988 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:26.725342 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001695 Jun 27 14:48:26.725497 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:26.744940 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writing DB stats nova_api:SELECT=3 {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:26.746625 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writing DB stats nova_cell0:SELECT=3 {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:26.747501 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writing DB stats nova_cell1:SELECT=3 {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:26.748865 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:27.279732 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-6cb17f3e-00b4-4399-9e97-a0834b549987 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:27.309748 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-6cb17f3e-00b4-4399-9e97-a0834b549987 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.576703 Jun 27 14:48:27.310276 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Mon Jun 27 14:48:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:48:29.418330 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:29.419476 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-83499d8b-d9cb-41d1-93c4-2cd45b26f868 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jun 27 14:48:29.420104 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:29.486681 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-cd2736e5-d18e-47fe-86a7-06682a45e377 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:29.505786 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:48:29.505786 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: warnings.warn(msg) Jun 27 14:48:29.594777 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-cd2736e5-d18e-47fe-86a7-06682a45e377 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.167904 Jun 27 14:48:29.595809 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:48:29.818960 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-7ec5c734-93dd-468d-9c0d-8ba6f5db02c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:29.821669 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:48:29.821669 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: warnings.warn(msg) Jun 27 14:48:29.824373 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_api:SELECT=3 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:29.825398 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_cell0:SELECT=3 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:29.826206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_cell1:SELECT=3 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:29.826905 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:29.964360 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-7ec5c734-93dd-468d-9c0d-8ba6f5db02c1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359773 Jun 27 14:48:29.965334 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Mon Jun 27 14:48:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:48:32.050039 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-cd2736e5-d18e-47fe-86a7-06682a45e377 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:32.051053 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-cd2736e5-d18e-47fe-86a7-06682a45e377 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 27 14:48:32.051446 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:32.160937 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-301ee4cf-ddb5-4659-bcdc-c5023ffd0020 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "id": "d1"}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:32.178754 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:48:32.178754 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: warnings.warn(msg) Jun 27 14:48:32.290952 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-301ee4cf-ddb5-4659-bcdc-c5023ffd0020 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.233554 Jun 27 14:48:32.291640 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:48:32.304461 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-6d68591a-218e-4631-8aec-0f467e811425 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:32.306025 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:48:32.306025 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: warnings.warn(msg) Jun 27 14:48:32.400046 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-6d68591a-218e-4631-8aec-0f467e811425 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099453 Jun 27 14:48:32.400630 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Mon Jun 27 14:48:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:48:34.543774 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-301ee4cf-ddb5-4659-bcdc-c5023ffd0020 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:34.544839 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-301ee4cf-ddb5-4659-bcdc-c5023ffd0020 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 27 14:48:34.545494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:34.608982 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-d69899fd-7cd1-413e-9e54-7e748d1e113e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "id": "d2"}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:34.694756 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-d69899fd-7cd1-413e-9e54-7e748d1e113e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143424 Jun 27 14:48:34.695289 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:48:34.707984 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-d80ecf32-61b6-47fa-bd5a-b1f3aa775a93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:34.777844 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-d80ecf32-61b6-47fa-bd5a-b1f3aa775a93 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073957 Jun 27 14:48:34.778670 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Mon Jun 27 14:48:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:48:36.907264 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-d69899fd-7cd1-413e-9e54-7e748d1e113e admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:36.908299 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-d69899fd-7cd1-413e-9e54-7e748d1e113e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 27 14:48:36.908838 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:36.967996 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-55ce017f-7583-4122-ac47-e8f79ecbd454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:37.041372 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-55ce017f-7583-4122-ac47-e8f79ecbd454 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.126864 Jun 27 14:48:37.041944 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:48:37.054460 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-87ae8288-e0af-4d6b-b891-09a0ca194b75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:37.148280 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-87ae8288-e0af-4d6b-b891-09a0ca194b75 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097345 Jun 27 14:48:37.148914 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Mon Jun 27 14:48:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:48:39.270115 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-55ce017f-7583-4122-ac47-e8f79ecbd454 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:39.271224 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-55ce017f-7583-4122-ac47-e8f79ecbd454 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jun 27 14:48:39.271690 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:39.331754 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-e0a617da-a7df-4a7a-884d-1d6adf6314a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "swap": 0, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G"}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:39.408556 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-e0a617da-a7df-4a7a-884d-1d6adf6314a0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131185 Jun 27 14:48:39.409126 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 14:48:39.422980 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-e51d9b2c-e299-45eb-a526-3c4aad744786 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:39.507738 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-e51d9b2c-e299-45eb-a526-3c4aad744786 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090379 Jun 27 14:48:39.508433 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Mon Jun 27 14:48:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:48:41.579135 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-e0a617da-a7df-4a7a-884d-1d6adf6314a0 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:41.584129 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-e0a617da-a7df-4a7a-884d-1d6adf6314a0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 27 14:48:41.584129 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:41.637654 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-3d8a56e0-d495-4323-a058-0d3825d41f8d admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:41.661324 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-3d8a56e0-d495-4323-a058-0d3825d41f8d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075048 Jun 27 14:48:41.661863 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Mon Jun 27 14:48:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:48:43.768102 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-e0a617da-a7df-4a7a-884d-1d6adf6314a0 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:43.769730 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-e0a617da-a7df-4a7a-884d-1d6adf6314a0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 Jun 27 14:48:43.770129 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:43.832808 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-acf7f1e9-5ddb-475f-a86f-ba7556682fa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "ram": 512}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:43.894608 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-acf7f1e9-5ddb-475f-a86f-ba7556682fa0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.118264 Jun 27 14:48:43.895162 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:48:43.908121 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-08737829-44fa-48b4-8f24-3adbd0297b0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:43.967271 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-08737829-44fa-48b4-8f24-3adbd0297b0d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063186 Jun 27 14:48:43.968135 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Mon Jun 27 14:48:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:48:46.191667 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-acf7f1e9-5ddb-475f-a86f-ba7556682fa0 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:46.196885 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-acf7f1e9-5ddb-475f-a86f-ba7556682fa0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 27 14:48:46.196885 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:46.260754 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-aa6f1d18-61eb-44e5-b214-e0e7cdbce378 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "disk": 20, "vcpus": 1, "id": "2", "rxtx_factor": 1.0}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:46.348052 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-aa6f1d18-61eb-44e5-b214-e0e7cdbce378 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.148653 Jun 27 14:48:46.348798 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 14:48:46.369230 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-3a66bfbe-27bb-42fa-8976-c47816fc787a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:46.452296 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-3a66bfbe-27bb-42fa-8976-c47816fc787a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094299 Jun 27 14:48:46.452903 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Mon Jun 27 14:48:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:48:48.523717 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-aa6f1d18-61eb-44e5-b214-e0e7cdbce378 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:48.524776 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-aa6f1d18-61eb-44e5-b214-e0e7cdbce378 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 27 14:48:48.525257 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:48.593693 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-d64c2eff-eb69-46d1-88f6-e6cdd12d6b35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:48.705736 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-d64c2eff-eb69-46d1-88f6-e6cdd12d6b35 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.172862 Jun 27 14:48:48.706360 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 14:48:48.719795 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-631b3e74-a40d-4d31-b771-41310ab87b73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:48.810355 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-631b3e74-a40d-4d31-b771-41310ab87b73 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095174 Jun 27 14:48:48.810954 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Mon Jun 27 14:48:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:48:50.865266 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-d64c2eff-eb69-46d1-88f6-e6cdd12d6b35 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:50.866278 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-d64c2eff-eb69-46d1-88f6-e6cdd12d6b35 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 27 14:48:50.866679 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:50.925451 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-68f6fe8c-1070-4ec2-9991-7622ed1e42b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "disk": 80, "rxtx_factor": 1.0}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:51.020320 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-68f6fe8c-1070-4ec2-9991-7622ed1e42b5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.147930 Jun 27 14:48:51.020886 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:48:51.038411 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-ee19b65d-0d55-4f1d-b04d-b7032d95c4dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:51.114953 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-ee19b65d-0d55-4f1d-b04d-b7032d95c4dd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085912 Jun 27 14:48:51.115837 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Mon Jun 27 14:48:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:48:53.189854 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-68f6fe8c-1070-4ec2-9991-7622ed1e42b5 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:48:53.190868 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-68f6fe8c-1070-4ec2-9991-7622ed1e42b5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 27 14:48:53.191298 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:48:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:48:53.257316 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-f96d2223-bada-4383-88a5-9303b3b0214b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge"}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:53.335859 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-f96d2223-bada-4383-88a5-9303b3b0214b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.138434 Jun 27 14:48:53.336413 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Mon Jun 27 14:48:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:48:53.348918 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-fa88e0f7-73d6-434a-a2f8-375df5d6dba7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:48:53.434208 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-fa88e0f7-73d6-434a-a2f8-375df5d6dba7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088770 Jun 27 14:48:53.435132 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Mon Jun 27 14:48:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:49:18.808114 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-f96d2223-bada-4383-88a5-9303b3b0214b admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:18.809157 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-f96d2223-bada-4383-88a5-9303b3b0214b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 27 14:49:18.809554 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:49:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:49:18.820700 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:49:18.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-2c402211-2391-4c47-8800-410bed210069 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:18.886420 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-2c402211-2391-4c47-8800-410bed210069 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070276 Jun 27 14:49:18.886948 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Mon Jun 27 14:49:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:49:19.796329 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-f96d2223-bada-4383-88a5-9303b3b0214b admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:19.798023 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-f96d2223-bada-4383-88a5-9303b3b0214b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Jun 27 14:49:19.798671 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:49:19.992880 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-dacae200-158f-47f9-9896-e7c2a46d434d admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:19.998436 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.wsgi [None req-dacae200-158f-47f9-9896-e7c2a46d434d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-dacae200-158f-47f9-9896-e7c2a46d434d admin admin] Request method failure captured: Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Accept: application/json Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Accept-Encoding: gzip, deflate Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Connection: keep-alive Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Content-Length: 0 Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Host: 10.222.0.44 Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Openstack-Api-Version: compute 2.90 Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Openstack-System-Scope: None Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: User-Agent: python-novaclient Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Auth-Token: gAAAAABiucNv9GS4C7-rgHBVd4TiP2AVotZ8h8sESusEHhjIsOh_H2UwIzL_0HvK-L0VLqMII6HqdEeZBCBX81TfWygnIWitYkHB5Wdx-tFrQJaXxiIbOpJBMf92vn9l-sr3Qj7Z0HUYAOKw3tqJUuSGTR83jRNc5PgFLDquXYBq8jC4-FqyRz8 Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Domain-Id: None Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Domain-Name: None Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Identity-Status: Confirmed Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Is-Admin-Project: True Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Domain-Id: default Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Domain-Name: Default Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Name: admin Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Role: member,reader,admin Jun 27 14:49:20.002394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Roles: member,reader,admin Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Tenant: admin Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Tenant-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Tenant-Name: admin Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User: admin Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Domain-Id: default Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Domain-Name: Default Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Id: 34ee4c4ab8ea4807905f919862ea9620 Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Name: admin Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: method: > Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: exception: Flavor 42 could not be found. Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: action_args: {'id': '42'} Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:49:20.003929 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:20.004861 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.005976 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-dacae200-158f-47f9-9896-e7c2a46d434d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:49:20.007046 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-dacae200-158f-47f9-9896-e7c2a46d434d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061604 Jun 27 14:49:20.007046 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Mon Jun 27 14:49:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:20.013280 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-31ec840e-5ea6-4185-9801-ff352786b869 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:20.016863 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:49:20.035388 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-31ec840e-5ea6-4185-9801-ff352786b869 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025629 Jun 27 14:49:20.035928 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Mon Jun 27 14:49:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:49:20.045707 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-1205e37f-35be-49ff-9c87-8b4b82da93b1 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:20.068755 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-1205e37f-35be-49ff-9c87-8b4b82da93b1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026627 Jun 27 14:49:20.069289 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Mon Jun 27 14:49:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:49:20.079931 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-7a059a01-79a8-4672-9b40-4ab347aaef55 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:20.085659 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.wsgi [None req-7a059a01-79a8-4672-9b40-4ab347aaef55 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-7a059a01-79a8-4672-9b40-4ab347aaef55 admin admin] Request method failure captured: Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Accept: application/json Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Accept-Encoding: gzip, deflate Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Connection: keep-alive Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Content-Length: 0 Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Host: 10.222.0.44 Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Openstack-Api-Version: compute 2.90 Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Openstack-System-Scope: None Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: User-Agent: python-novaclient Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Auth-Token: gAAAAABiucNv9GS4C7-rgHBVd4TiP2AVotZ8h8sESusEHhjIsOh_H2UwIzL_0HvK-L0VLqMII6HqdEeZBCBX81TfWygnIWitYkHB5Wdx-tFrQJaXxiIbOpJBMf92vn9l-sr3Qj7Z0HUYAOKw3tqJUuSGTR83jRNc5PgFLDquXYBq8jC4-FqyRz8 Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Domain-Id: None Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Domain-Name: None Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Identity-Status: Confirmed Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Is-Admin-Project: True Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Domain-Id: default Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Domain-Name: Default Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Name: admin Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Role: member,reader,admin Jun 27 14:49:20.088966 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Roles: member,reader,admin Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Tenant: admin Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Tenant-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Tenant-Name: admin Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User: admin Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Domain-Id: default Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Domain-Name: Default Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Id: 34ee4c4ab8ea4807905f919862ea9620 Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Name: admin Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: method: > Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: exception: Flavor 42 could not be found. Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: action_args: {'id': '42'} Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:49:20.090494 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:20.091432 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:20.092818 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-7a059a01-79a8-4672-9b40-4ab347aaef55 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:49:20.094875 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-7a059a01-79a8-4672-9b40-4ab347aaef55 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015168 Jun 27 14:49:20.094875 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Mon Jun 27 14:49:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:20.911619 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-1205e37f-35be-49ff-9c87-8b4b82da93b1 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:20.912630 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-1205e37f-35be-49ff-9c87-8b4b82da93b1 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 27 14:49:20.913044 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:49:21.102450 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-332e2bea-001c-4437-a718-28880e55e91c admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:21.108345 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.wsgi [None req-332e2bea-001c-4437-a718-28880e55e91c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-332e2bea-001c-4437-a718-28880e55e91c admin admin] Request method failure captured: Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Accept: application/json Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Accept-Encoding: gzip, deflate Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Connection: keep-alive Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Content-Length: 0 Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Host: 10.222.0.44 Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Openstack-Api-Version: compute 2.90 Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Openstack-System-Scope: None Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: User-Agent: python-novaclient Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Auth-Token: gAAAAABiucNw57_zqRJ76w-LMQ0vlqcFu6Q9yQVZTO-gSsMogw5ESwLHIyqnqsE4QdcACOlsTbLH59nKMTbDftAOiMWWiQjtqK71w5thbZpikNHQXKTIqC44voSezjhON4qqXCqqOskfN4wVPmHmyPxnB8XI8XjtKgoTn6d4RMVLcwZ1lHDBYVI Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Domain-Id: None Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Domain-Name: None Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Identity-Status: Confirmed Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Is-Admin-Project: True Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Domain-Id: default Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Domain-Name: Default Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Name: admin Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Role: member,reader,admin Jun 27 14:49:21.110375 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Roles: member,reader,admin Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Tenant: admin Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Tenant-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Tenant-Name: admin Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User: admin Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Domain-Id: default Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Domain-Name: Default Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Id: 34ee4c4ab8ea4807905f919862ea9620 Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Name: admin Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: method: > Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: exception: Flavor 84 could not be found. Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: action_args: {'id': '84'} Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:49:21.111934 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:21.112855 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.114206 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-332e2bea-001c-4437-a718-28880e55e91c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:49:21.115484 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-332e2bea-001c-4437-a718-28880e55e91c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061488 Jun 27 14:49:21.115484 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Mon Jun 27 14:49:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:21.121531 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-003f0016-f9d7-49e4-922c-7d2ccc40f0e6 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:21.135110 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-003f0016-f9d7-49e4-922c-7d2ccc40f0e6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017154 Jun 27 14:49:21.135638 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Mon Jun 27 14:49:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:49:21.145769 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-e85091cc-136e-4003-bcf5-718fe3647c4e admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:21.163946 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-e85091cc-136e-4003-bcf5-718fe3647c4e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021878 Jun 27 14:49:21.164687 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Mon Jun 27 14:49:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:49:21.174679 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-eb73e018-a1b0-4edb-82e4-0c5944103648 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:21.180029 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.wsgi [None req-eb73e018-a1b0-4edb-82e4-0c5944103648 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-eb73e018-a1b0-4edb-82e4-0c5944103648 admin admin] Request method failure captured: Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Accept: application/json Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Accept-Encoding: gzip, deflate Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Connection: keep-alive Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Content-Length: 0 Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Host: 10.222.0.44 Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Openstack-Api-Version: compute 2.90 Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Openstack-System-Scope: None Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: User-Agent: python-novaclient Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Auth-Token: gAAAAABiucNw57_zqRJ76w-LMQ0vlqcFu6Q9yQVZTO-gSsMogw5ESwLHIyqnqsE4QdcACOlsTbLH59nKMTbDftAOiMWWiQjtqK71w5thbZpikNHQXKTIqC44voSezjhON4qqXCqqOskfN4wVPmHmyPxnB8XI8XjtKgoTn6d4RMVLcwZ1lHDBYVI Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Domain-Id: None Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Domain-Name: None Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Identity-Status: Confirmed Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Is-Admin-Project: True Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Domain-Id: default Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Domain-Name: Default Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Name: admin Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Role: member,reader,admin Jun 27 14:49:21.181563 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Roles: member,reader,admin Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Tenant: admin Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Tenant-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Tenant-Name: admin Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User: admin Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Domain-Id: default Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Domain-Name: Default Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Id: 34ee4c4ab8ea4807905f919862ea9620 Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Name: admin Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: method: > Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: exception: Flavor 84 could not be found. Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: action_args: {'id': '84'} Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:49:21.183163 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:21.184147 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:21.185522 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-eb73e018-a1b0-4edb-82e4-0c5944103648 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:49:21.186819 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-eb73e018-a1b0-4edb-82e4-0c5944103648 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012098 Jun 27 14:49:21.186819 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Mon Jun 27 14:49:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:21.992029 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-e85091cc-136e-4003-bcf5-718fe3647c4e admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:21.993118 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-e85091cc-136e-4003-bcf5-718fe3647c4e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 27 14:49:21.993510 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:49:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:49:22.181820 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-0fb6d398-5496-4bde-a912-15e68f170806 admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:22.187610 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.wsgi [None req-0fb6d398-5496-4bde-a912-15e68f170806 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-0fb6d398-5496-4bde-a912-15e68f170806 admin admin] Request method failure captured: Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Accept: application/json Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Accept-Encoding: gzip, deflate Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Connection: keep-alive Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Content-Length: 0 Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Host: 10.222.0.44 Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Openstack-Api-Version: compute 2.90 Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Openstack-System-Scope: None Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: User-Agent: python-novaclient Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Auth-Token: gAAAAABiucNxA_bAQrUJkABOafCiIf0XCxaHM5kZja-XRl08qQ-8ri5w2EWsCZDXWJ_Ed92buaaGZkGSSzbd3LEeXJmMrkbNud9DSITIMCD98SKKINEgA6u5nAuANhOlo_YqPJ3XNb-HaNNt0VpIKe0uyj5QBcuJ8b0mZY8KU5QpQ7i_Vw1mv3Q Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Domain-Id: None Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Domain-Name: None Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Identity-Status: Confirmed Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Is-Admin-Project: True Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Domain-Id: default Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Domain-Name: Default Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Project-Name: admin Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Role: member,reader,admin Jun 27 14:49:22.189172 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Roles: member,reader,admin Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Tenant: admin Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Tenant-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-Tenant-Name: admin Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User: admin Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Domain-Id: default Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Domain-Name: Default Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Id: 34ee4c4ab8ea4807905f919862ea9620 Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: X-User-Name: admin Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: method: > Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: exception: Flavor 451 could not be found. Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: action_args: {'id': '451'} Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:49:22.190750 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:22.192883 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.194173 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-0fb6d398-5496-4bde-a912-15e68f170806 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:49:22.195411 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-0fb6d398-5496-4bde-a912-15e68f170806 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059699 Jun 27 14:49:22.195411 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Mon Jun 27 14:49:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:22.200421 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-20156264-e862-47d4-a3fb-677aeff3c648 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:22.214052 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-20156264-e862-47d4-a3fb-677aeff3c648 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017123 Jun 27 14:49:22.214514 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Mon Jun 27 14:49:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:49:22.224631 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:22.238754 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017667 Jun 27 14:49:22.239269 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Mon Jun 27 14:49:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:49:22.248362 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-4b1c9de8-affc-4dd8-ae84-9fd1b19d0218 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:22.253949 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.wsgi [None req-4b1c9de8-affc-4dd8-ae84-9fd1b19d0218 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-4b1c9de8-affc-4dd8-ae84-9fd1b19d0218 admin admin] Request method failure captured: Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Accept: application/json Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Accept-Encoding: gzip, deflate Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Connection: keep-alive Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Content-Length: 0 Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Host: 10.222.0.44 Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Openstack-Api-Version: compute 2.90 Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Openstack-System-Scope: None Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: User-Agent: python-novaclient Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Auth-Token: gAAAAABiucNxA_bAQrUJkABOafCiIf0XCxaHM5kZja-XRl08qQ-8ri5w2EWsCZDXWJ_Ed92buaaGZkGSSzbd3LEeXJmMrkbNud9DSITIMCD98SKKINEgA6u5nAuANhOlo_YqPJ3XNb-HaNNt0VpIKe0uyj5QBcuJ8b0mZY8KU5QpQ7i_Vw1mv3Q Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Domain-Id: None Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Domain-Name: None Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Identity-Status: Confirmed Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Is-Admin-Project: True Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Domain-Id: default Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Domain-Name: Default Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Project-Name: admin Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Role: member,reader,admin Jun 27 14:49:22.255513 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Roles: member,reader,admin Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782bd5d4029d44cc9364a47cef782a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Tenant: admin Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Tenant-Id: 782bd5d4029d44cc9364a47cef782a05 Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-Tenant-Name: admin Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User: admin Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Domain-Id: default Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Domain-Name: Default Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Id: 34ee4c4ab8ea4807905f919862ea9620 Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: X-User-Name: admin Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: method: > Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: exception: Flavor 451 could not be found. Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: action_args: {'id': '451'} Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:49:22.257078 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:22.258093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: ERROR nova.api.openstack.wsgi Jun 27 14:49:22.259385 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-4b1c9de8-affc-4dd8-ae84-9fd1b19d0218 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:49:22.260606 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-4b1c9de8-affc-4dd8-ae84-9fd1b19d0218 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011950 Jun 27 14:49:22.260835 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Mon Jun 27 14:49:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:23.086055 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:23.087122 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 27 14:49:23.087509 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:49:23.276329 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-b411db46-f48e-4e6a-94dc-57a93ff1110c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:49:23.371643 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-b411db46-f48e-4e6a-94dc-57a93ff1110c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.146803 Jun 27 14:49:23.372105 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Mon Jun 27 14:49:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:49:24.190822 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:24.191831 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 27 14:49:24.192225 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:49:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:49:24.382272 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-fbc4d60b-d07a-4de2-b6f9-a333de5bf5a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:49:24.498169 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-fbc4d60b-d07a-4de2-b6f9-a333de5bf5a0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.167252 Jun 27 14:49:24.498708 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Mon Jun 27 14:49:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:49:25.315772 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:25.316857 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 27 14:49:25.317251 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:49:25.508848 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-9d8f23f8-fa2d-49ed-9353-47af065d236e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:49:25.601556 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-9d8f23f8-fa2d-49ed-9353-47af065d236e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.143632 Jun 27 14:49:25.602093 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Mon Jun 27 14:49:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 14:49:26.421682 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:26.422772 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Jun 27 14:49:26.423161 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:49:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:49:26.611808 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-fe53386d-8d28-450b-bf3f-51ff2516aada admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:49:26.681060 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-fe53386d-8d28-450b-bf3f-51ff2516aada admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.120815 Jun 27 14:49:26.681897 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Mon Jun 27 14:49:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:49:27.497520 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:27.498533 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 27 14:49:27.498933 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:49:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:49:27.686020 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-560857ec-4d7b-4755-a9c6-a18e9571b6bb admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:49:27.706028 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-560857ec-4d7b-4755-a9c6-a18e9571b6bb admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070921 Jun 27 14:49:27.706553 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Mon Jun 27 14:49:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:50:14.520747 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:50:14.521847 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-922a8ba3-0db4-437e-9410-f18371bf90cd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 27 14:50:14.522226 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Mon Jun 27 14:50:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:50:14.532466 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:50:14.580673 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-fe319929-58d1-43e1-b82c-d6c83b2bb2a3 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:50:14.600372 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-fe319929-58d1-43e1-b82c-d6c83b2bb2a3 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072313 Jun 27 14:50:14.600954 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Mon Jun 27 14:50:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:50:14.624324 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-4bdf2d32-3182-481c-a42b-134ceed097cc admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:50:14.627787 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG dbcounter [-] [115165] Writing DB stats nova_api:SELECT=14 {{(pid=115165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:50:14.632815 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-4bdf2d32-3182-481c-a42b-134ceed097cc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012669 Jun 27 14:50:14.633340 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Mon Jun 27 14:50:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:50:14.645257 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-d8995661-ec93-44d3-93d9-39344c8de793 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:50:14.653004 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-d8995661-ec93-44d3-93d9-39344c8de793 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011312 Jun 27 14:50:14.653523 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Mon Jun 27 14:50:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:50:14.664915 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:50:14.672587 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011539 Jun 27 14:50:14.673132 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Mon Jun 27 14:50:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:50:14.683985 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-d39df8ea-8533-4d5e-b8f8-c04f0152ac3a admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:50:14.691912 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-d39df8ea-8533-4d5e-b8f8-c04f0152ac3a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011327 Jun 27 14:50:14.692422 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Mon Jun 27 14:50:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:53:38.452927 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:53:38.453944 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 27 14:53:38.454336 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:53:38.597196 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_api:SELECT=6 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:53:38.707689 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-3ec9fe5a-8038-4133-b37a-8a1a1b5d9019 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:53:38.708866 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:53:38.708866 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: warnings.warn(msg) Jun 27 14:53:38.710060 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-3ec9fe5a-8038-4133-b37a-8a1a1b5d9019 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:53:38.710496 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-3ec9fe5a-8038-4133-b37a-8a1a1b5d9019 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:53:38.711282 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-3ec9fe5a-8038-4133-b37a-8a1a1b5d9019 admin admin] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:53:38.711706 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-3ec9fe5a-8038-4133-b37a-8a1a1b5d9019 admin admin] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:53:38.745760 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-3ec9fe5a-8038-4133-b37a-8a1a1b5d9019 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.150059 Jun 27 14:53:38.746315 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Mon Jun 27 14:53:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:53:39.566783 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:53:39.567798 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 27 14:53:39.568442 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:53:39.761018 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-0ec624ff-5b07-49c6-9d91-a2ff8db08fd7 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:53:39.762226 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:53:39.762226 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: warnings.warn(msg) Jun 27 14:53:39.764090 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-0ec624ff-5b07-49c6-9d91-a2ff8db08fd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:53:39.764532 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-0ec624ff-5b07-49c6-9d91-a2ff8db08fd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:53:39.765386 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-0ec624ff-5b07-49c6-9d91-a2ff8db08fd7 admin admin] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:53:39.765811 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-0ec624ff-5b07-49c6-9d91-a2ff8db08fd7 admin admin] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:53:39.785630 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-0ec624ff-5b07-49c6-9d91-a2ff8db08fd7 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077140 Jun 27 14:53:39.786196 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Mon Jun 27 14:53:39 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:53:51.062677 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:53:51.063884 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Jun 27 14:53:51.064280 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:53:51.208600 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_cell0:SELECT=4 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:53:51.209393 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_cell1:SELECT=4 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:53:51.210002 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG dbcounter [-] [115164] Writing DB stats nova_api:SELECT=8 {{(pid=115164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:53:51.257101 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-6c5dbcac-115e-44aa-8df5-c2ac9c8952c3 admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:53:51.258300 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:53:51.258300 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: warnings.warn(msg) Jun 27 14:53:51.259602 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-6c5dbcac-115e-44aa-8df5-c2ac9c8952c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:53:51.260047 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-6c5dbcac-115e-44aa-8df5-c2ac9c8952c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:53:51.260899 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-6c5dbcac-115e-44aa-8df5-c2ac9c8952c3 admin admin] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:53:51.261359 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-6c5dbcac-115e-44aa-8df5-c2ac9c8952c3 admin admin] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:53:51.287104 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-6c5dbcac-115e-44aa-8df5-c2ac9c8952c3 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083406 Jun 27 14:53:51.287665 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Mon Jun 27 14:53:51 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:53:52.143973 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: DEBUG nova.api.openstack.wsgi [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] Calling method '>' {{(pid=115165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:53:52.145007 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: INFO nova.api.openstack.requestlog [None req-719896b6-b187-46d7-9306-bf756f1f559a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 27 14:53:52.145394 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: [pid: 115165|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Mon Jun 27 14:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:53:52.340629 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG nova.api.openstack.wsgi [None req-8844f284-c263-4551-a6d1-268119220b8e admin admin] Calling method '>' {{(pid=115164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:53:52.342678 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:53:52.342678 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: warnings.warn(msg) Jun 27 14:53:52.343921 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-8844f284-c263-4551-a6d1-268119220b8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:53:52.344367 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-8844f284-c263-4551-a6d1-268119220b8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:53:52.345213 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-8844f284-c263-4551-a6d1-268119220b8e admin admin] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:53:52.345643 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: DEBUG oslo_concurrency.lockutils [None req-8844f284-c263-4551-a6d1-268119220b8e admin admin] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:53:52.367464 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: INFO nova.api.openstack.requestlog [None req-8844f284-c263-4551-a6d1-268119220b8e admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079410 Jun 27 14:53:52.367950 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: [pid: 115164|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Mon Jun 27 14:53:52 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:54:50.254680 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: Mon Jun 27 14:54:50 2022 - graceful shutdown triggered... Jun 27 14:54:50.255188 dv-cinder-797608-35-iscsi devstack@n-api.service[115164]: Gracefully killing worker 1 (pid: 115164)... Jun 27 14:54:50.254796 dv-cinder-797608-35-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 27 14:54:50.255990 dv-cinder-797608-35-iscsi devstack@n-api.service[115165]: Gracefully killing worker 2 (pid: 115165)... Jun 27 14:54:51.255825 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: worker 1 buried after 1 seconds Jun 27 14:54:51.256314 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: worker 2 buried after 1 seconds Jun 27 14:54:51.256314 dv-cinder-797608-35-iscsi devstack@n-api.service[115163]: goodbye to uWSGI. Jun 27 14:54:51.257359 dv-cinder-797608-35-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 27 14:54:51.257978 dv-cinder-797608-35-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 27 14:54:51.260794 dv-cinder-797608-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 14:54:51.272467 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 14:54:51 2022] *** Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: nodename: dv-cinder-797608-35-iscsi Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: machine: x86_64 Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: clock source: unix Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: pcre jit disabled Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: detected number of CPU cores: 4 Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: current working directory: / Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: detected binary path: /usr/bin/uwsgi-core Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: your processes number limit is 47680 Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: your memory page size is 4096 bytes Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: detected max file descriptor number: 2048 Jun 27 14:54:51.275111 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: lock engine: pthread robust mutexes Jun 27 14:54:51.276096 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: thunder lock: enabled Jun 27 14:54:51.276096 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 14:54:51.276096 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 14:54:51.321167 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: Python main interpreter initialized at 0x55c46f97e9c0 Jun 27 14:54:51.321167 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: python threads support enabled Jun 27 14:54:51.321167 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: your server socket listen backlog is limited to 100 connections Jun 27 14:54:51.321167 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: your mercy for graceful operations on workers is 90 seconds Jun 27 14:54:51.321631 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 14:54:51.321631 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: *** Operational MODE: preforking *** Jun 27 14:54:51.321884 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: *** uWSGI is running in multiple interpreter mode *** Jun 27 14:54:51.321884 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: spawned uWSGI master process (pid: 129670) Jun 27 14:54:51.322089 dv-cinder-797608-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 14:54:51.322711 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: spawned uWSGI worker 1 (pid: 129686, cores: 1) Jun 27 14:54:51.323069 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: spawned uWSGI worker 2 (pid: 129687, cores: 1) Jun 27 14:54:51.323228 dv-cinder-797608-35-iscsi devstack@n-api.service[129670]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 14:54:51.991927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 14:54:52.015645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 14:54:53.196382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:54:53.196382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: from cryptography.utils import int_from_bytes Jun 27 14:54:53.197030 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:54:53.197030 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: from cryptography.utils import int_from_bytes Jun 27 14:54:53.257200 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:54:53.257200 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: from cryptography.utils import int_from_bytes Jun 27 14:54:53.257798 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:54:53.257798 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: from cryptography.utils import int_from_bytes Jun 27 14:54:55.590895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 14:54:55.591444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 14:54:55.591683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 14:54:55.592031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 14:54:55.592285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 14:54:55.592709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.593022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.593869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.594187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.594621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.594822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.595138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.595670 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.596010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.596270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.596584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.596934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-35-iscsi {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.597257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.597564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.597872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.598196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.598500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.598822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.599135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.599635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.600931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.600931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.600931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.601148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.601320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.601626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.601949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.602258 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.602580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.602889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.603287 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-35-iscsi {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.603603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.603911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.604219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.604637 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.604968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.605279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.605598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.605917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.606225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.606546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.606865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.607183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.607498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.607799 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.608106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.608416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.609381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.616486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.616486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.616486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.616486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.616486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.616486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.616486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.617594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.618095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.618095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.618095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.618095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.618095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.618095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.618095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.618558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.618558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.619089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.619214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.619432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.619736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.620055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.620389 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.620712 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.620963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.621264 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.621688 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.621887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.622763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.622763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.622763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.623140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.623455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.623671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.623974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.624277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.624662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.624976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.625280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.625606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.625886 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.626598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.626598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.626800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.627105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.627406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.627883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.628366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.628689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.629158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.629483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.629793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.630102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.630417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.630723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.631029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.631346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.631644 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.631952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.632266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.632571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.632898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.633204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.633509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.633813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.634119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.634422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.634725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.635023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.635345 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.635671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.635981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.636284 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.636587 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.636924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.637259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.637588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.637930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.638241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.638570 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.638896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.639235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.639515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.639826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.640171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.640484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.640809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.645168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.645168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.645168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.645168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.645168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.645168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.645168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.645168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.646206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.646206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.646206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.646206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.646206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.646206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.646206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.646206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.647184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.647184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.647184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.647184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.647680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.647680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.647930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.648263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.648450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.648778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.649089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.649399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.649706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.650041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.650355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.650723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.651034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.651348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.651684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.651973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.652282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.652582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.652913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.653216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.653523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.653953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.654196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.654472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.655287 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.655287 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.656080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.657022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.657022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.657022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.657372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.657669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.657986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.658471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.658619 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.658922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.659233 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.659555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.659867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.660174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.660497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.660839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.661153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.661466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.661777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.662104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.662420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.662731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.663067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.663399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.663707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.664032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.664358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.664694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.665002 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.665312 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.665617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.665921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.666221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.666530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.666833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.667149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.667439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.667741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.668046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.668912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.668912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.669250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.669250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.669563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.669908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.670213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.670558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.671012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.671884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.672289 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.672839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.673026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.673342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.673940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.673940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.674282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.674648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.674892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.675586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.675586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.675852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.676125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.676445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.676780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.677097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.677440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.677777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.678097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.678420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.678714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.679087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.679340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.679653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.679963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.680275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.680594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.680933 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.681254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.681561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.681887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.682205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.682527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.682832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.683148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.683478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.683811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.684120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.684431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.684784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.685098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.685409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.685721 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.686027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.686333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.686643 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.687023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.687434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.687896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.688280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.688794 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.689104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.689368 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.689625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.689938 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.690255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.690566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.690891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.691212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.691519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.691823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.692404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.692739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.693047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.693352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.693659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.694008 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.694320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.694626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.694942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.695265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.695576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.695894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.696205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.696514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.696861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.697175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.697486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.697798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.698110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.698422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.698758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.699036 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.700304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.700304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.700304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.700304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.700865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.700865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.701814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.702157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.702562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.702887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.703301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.703532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.704679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.704679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.704679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.705248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.705248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.705492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.705746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.706058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.706388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.706655 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.706961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.707271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.707574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.707877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.708179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.708482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.708826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.709132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.709445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.709750 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.710079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.710395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.710697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.711000 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.711303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.711646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.711949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.712282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.712609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.712972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.713278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.713583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.713907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.714291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.714511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.714812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.715120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.715426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.715727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.716038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.716345 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.716696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.716977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.717279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.717586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.717888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.718736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.719048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.719350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.719654 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.719965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.720323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.720598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.720894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.721199 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.721516 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.721822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.722139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.722425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.722736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.723043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.723346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.723673 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.723983 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.724285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.724628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.724911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.725212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.725515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.725822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.726141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.726460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.726763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.727071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.727442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.727669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.727972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.728899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.728899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.728899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.729196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.729469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.729802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.730095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.730406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.730707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.731016 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.731316 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.731667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.731970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.732331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.732636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.732979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.733422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.733806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.734741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.735008 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.735314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.735630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.735946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.736264 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.736571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.736899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.737224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.737535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.737845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.738167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.738489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.738813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.739117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.739426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.739752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.740048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.740356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.740681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.740993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.741304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.741615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.741925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.742236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.742540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.742852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.743158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.743462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.743787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.744094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.744398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.744726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.745032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.745341 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.745645 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.746086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.746401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.746707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.747015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.747320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.747629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.747942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.748255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.748560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.749003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.749350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.750161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.750469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.750772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.751078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.751388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.751710 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.752012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.752312 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.752616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.752980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.753286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.753606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.754026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.754338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.754640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.755051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.755362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.755671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.756001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.756314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.756689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.756962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.757278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.757586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.757907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.758230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.758541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.758854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.759158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.759477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.759797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.760109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.760431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.760874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.761205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.761514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.761832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.761990 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 14:54:55.762476 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 14:54:55.762620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.762620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.762908 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 14:54:55.763052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.763194 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 14:54:55.763357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.763357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.763636 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 14:54:55.763801 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.763950 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.764101 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.764251 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.764404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.764561 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.764734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.764905 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.765624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.765776 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.765929 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.766123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.766272 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.766415 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.766558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.766719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.766873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.767031 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.767175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.767364 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.767512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.767682 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.767922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.768075 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.768235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.768379 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-35-iscsi {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.768766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.768919 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.769493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.769655 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.769799 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.769950 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.770094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.770238 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.770409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.770646 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.770795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.770946 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.771090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.771250 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.771475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.771475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.771871 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.772041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.772194 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.772348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.772509 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.772681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.772844 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.772996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.773140 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.773298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.773449 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.773592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.773750 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.773898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.774056 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.774245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.774400 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.774560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.774704 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.774855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.775012 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.775164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.775315 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-35-iscsi {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.775466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.775609 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.775761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.775905 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.776047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.776198 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.776348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.776348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.776686 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.776839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.776983 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.777137 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.777433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.777584 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.777736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.777887 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.778031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.778173 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.778339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.778482 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.778632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.778774 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.778924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.779076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.779672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.779834 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.779986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.780139 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.780291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.780441 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.780633 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.780871 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.781029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.781174 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.781317 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.781492 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.781727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.781941 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.782115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.782329 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.782476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.782476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.782765 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.782919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.783106 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.783262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.783405 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.783560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.783718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.783869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.784011 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.784162 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.784353 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.784509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.784711 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.784883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.785034 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.785185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.785341 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.785490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.785633 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.785784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.785927 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.785927 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.786211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.786364 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.786507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.786649 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.786813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.786970 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.787114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.787114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.787492 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.787674 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.787831 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.787990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.788134 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.788285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.788429 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.788579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.788755 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.788916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.789067 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.789211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.789869 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.790024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.790183 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.790382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.790538 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.790683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.790859 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.791073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.791230 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.791393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.791537 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.791708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.791938 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.792153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.792327 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.792472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.792616 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.792795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.792954 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.793108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.793260 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.793414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.793558 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.793711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.793856 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.794077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.794231 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.794382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.794532 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.794676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.794828 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.794980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.795131 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.795292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.795443 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.795587 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.795739 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.795884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.796034 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.796245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.796410 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.796563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.796747 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.796904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.797048 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.797191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.797352 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.797496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.797654 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.797804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.797949 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.798092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.798235 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.798386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.798538 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.798681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.798823 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.798966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.799120 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.799278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.799448 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.800052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.800217 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.800363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.800506 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.800701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.800853 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.800999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.801227 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.801376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.801530 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.801702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.801846 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.802073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.802073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.802454 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.802605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.802748 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.802898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.803049 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.803207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.803352 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.803495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.803654 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.803810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.803968 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.804112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.804266 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.804418 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.804569 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.804733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.804891 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.805043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.805189 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.805339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.805498 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.805650 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.805812 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.805963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.806108 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.806251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.806394 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.806536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.806692 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.806843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.806986 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.807137 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.807288 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.807446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.807599 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.807750 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.807893 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.808035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.808185 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.808338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.808482 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.808625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.808829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.808973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.809127 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.809285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.809430 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.809583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.810216 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.810378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.810525 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.810681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.810827 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.810985 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.811138 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:54:55.811455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.811619 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.811775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.812727 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.812916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.813075 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.813219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.813377 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.813529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.813686 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.813832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.813976 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.814127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.814284 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.814428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.814572 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.814716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.814716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.815618 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.815781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.815926 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.816078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.816222 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.816401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.816560 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.816727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.816875 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.817278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.817278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.817555 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.817726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.817888 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.818032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.818176 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.818327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.818470 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.818627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.818779 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.818923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.819066 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.819210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.819353 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.819628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.819845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.820540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.820852 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.821020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.821422 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.821592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.821738 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.821880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.822033 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.822184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.822344 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.822726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.822886 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.823043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.823196 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.823340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.823513 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.823669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.823822 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.823973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.824117 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.824270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.824424 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.824574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.824742 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.824903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.825047 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.825203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.825346 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.825489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.825639 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.825790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.825941 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.826160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.826307 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.826458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.826609 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.826753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.826907 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.827059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.827211 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.827355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.828170 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.828346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.828508 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.828700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.828943 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.829207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.829361 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.829519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.829694 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.829853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.830023 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.830775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.830955 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.831114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.831279 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.831431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.831685 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.831851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.832011 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.832179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.832344 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.832514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.832823 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.832995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.833147 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.833311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.833463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.833624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.833783 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.833942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.834100 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.834264 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.834415 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.834573 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.834573 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.834880 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.835040 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.835200 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.835358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.835516 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.835668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.835817 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.835974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.836139 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.836297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.836461 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.836621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.836796 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.836965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.837145 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.837887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.838059 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.838213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.838364 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.838530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.838681 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.838841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.838992 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.839149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.839311 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.839472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.839623 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.839773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.839931 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.840090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.840277 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.840979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.841143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.841302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.841460 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.841642 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.841891 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.842058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.842217 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.842368 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.842518 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.842668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.842966 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.843236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.843542 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.843986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.844150 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.844309 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.844469 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.844632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.844820 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.844973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.844973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.845282 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.845440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.845591 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.845740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.845905 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.846055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.846232 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.846923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.847084 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.847255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.847413 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.847618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.847782 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.847934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.848093 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.848252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.848410 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.848675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.848882 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.849046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.849205 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.849365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.849533 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.849693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.849850 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.850020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.850270 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.850427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.850850 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.851209 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.851480 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.851638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.851789 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.852065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.852237 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.852390 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.852550 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.852764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.853074 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.853320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.853483 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.853634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.853784 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.853943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.853943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.854260 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.854422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.854422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.854908 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.855074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.855074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.855381 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.855534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.855692 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.855841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.855991 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.856161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.856473 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.856662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.856831 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.857003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.858001 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.858179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.858341 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.858494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.859183 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.859375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.859528 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.859690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.859850 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.860009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.860168 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.860338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.860496 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.860687 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.861280 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.861444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.861596 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.861747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.861924 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.862249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.862551 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.862717 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.862911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.863252 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.863422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.863575 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.863725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.863875 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.864034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.864194 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.864356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.864508 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.864686 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.864844 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.865008 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.865168 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.865336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.865487 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.865645 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.865804 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.865967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.866127 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.866278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.866428 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.866578 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.866728 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.866893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.867051 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.867211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.867362 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.867518 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.867669 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.867832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.867991 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868350 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 14:54:55.868718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.868718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.869909 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.869909 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.869909 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.869909 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.869909 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.869909 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.869909 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.869909 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.871418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.871418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.871418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.871418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.871418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.871418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.871418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.871418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.872845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.872845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.872845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.872845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.872845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.872845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.872845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.872845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.874172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.874172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.874172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.874172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.874172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.874172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.874172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.874172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.875719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.875719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.875719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.875719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.875719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.875719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.875719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.875719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.876463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.876463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.876463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.876463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.876463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.876463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.876463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.876463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.877243 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.877361 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.877691 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.878042 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.880751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.880751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.880751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.880751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.880751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.880751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.880751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.880751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.882080 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.882080 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.882080 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.882080 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.882698 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.882698 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.882920 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.883121 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.883491 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.883756 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.884085 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.884402 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.884765 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.885086 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.885402 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.885715 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.886030 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.886384 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.886697 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.887046 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.887385 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.887736 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.888050 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.888364 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.888725 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.889042 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.889355 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.889667 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.890022 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.890566 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.890959 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.891287 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.891825 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.891983 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.892226 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.892560 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.892904 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.893219 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.893603 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.893859 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.894180 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.894494 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.894815 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.895134 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.895447 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.895767 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.896081 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.896409 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.896774 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.897091 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.897406 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.897725 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.898042 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.898354 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.898684 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.899002 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.899313 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.899624 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.899940 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.900251 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.900562 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.900904 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.901235 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.901805 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.902051 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.902208 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.902477 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.902795 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.903099 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.903409 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.903727 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.904042 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.904353 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.904741 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.904998 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.905329 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.905685 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.906204 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.906695 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.907013 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.907371 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.907690 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.908062 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.908379 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.908734 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.909067 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.909388 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.909708 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.910027 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.910340 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.910662 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.910982 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.911433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.911604 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.912064 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.912312 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.912528 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.912882 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.913198 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.913527 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.913858 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.914173 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.914511 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.914797 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.915112 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.915430 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.915745 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.916063 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.916383 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.916729 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.917053 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.917374 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.917689 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.918007 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.918176 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO dbcounter [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Registered counter for database nova_api Jun 27 14:54:55.918351 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.918623 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.918957 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.919276 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.919587 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.919902 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.920213 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.920529 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.921027 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.922170 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.922507 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.922936 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.923199 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.923505 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.923946 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.924156 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.924478 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.924931 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.925247 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.925570 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.925890 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.926210 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.926974 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.926974 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.927289 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.927454 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.927735 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.928054 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.928612 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.928982 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.929295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.929629 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.930065 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.930387 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.930718 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.931127 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.931447 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.931763 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.932312 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.932509 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.932807 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.933073 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.933382 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.934866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.934866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.934866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.934866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.935731 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.935731 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.935731 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.936404 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.936404 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.936993 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.937838 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.938442 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.938853 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.939194 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.939534 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.939852 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.940170 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.940359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_db.sqlalchemy.engines [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:54:55.940541 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.940826 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.941146 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.941478 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.941799 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.942510 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.942716 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.942998 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.943311 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.943625 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.943960 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.944273 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.944604 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.944996 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.945283 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.945614 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.945928 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.946257 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.946574 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.946886 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.947197 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.947509 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.947644 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writer thread running {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:54:55.947859 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.948171 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.948497 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.948864 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.949198 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.949516 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.949854 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.950187 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.950512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.950835 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.951167 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.951479 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.951791 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.952107 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.952448 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.953036 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.953575 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.953899 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.954218 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.954528 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.954841 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.955175 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.955488 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.955819 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.956136 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.956448 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.956790 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.957103 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.957455 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.957768 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.958113 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.958441 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.958772 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.959109 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.959428 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.959759 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.960083 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.960406 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.960760 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.961086 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.961409 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.961732 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.962053 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.962369 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.962691 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.963014 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.963340 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.963912 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.964254 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.964579 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.964928 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.965371 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.965702 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.966027 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.966349 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.966669 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.966989 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.967307 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.967647 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.967979 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.968423 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.969092 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.969426 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.969752 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.970133 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.970459 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.970829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.971142 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.971454 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.971777 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.972098 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.972420 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.972767 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.973086 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.973400 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.973725 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.974052 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.974371 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.974694 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.975015 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.975352 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.975694 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.976023 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.976343 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.976722 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.977007 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.977546 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.977866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.978208 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.978540 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.978870 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.979195 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.979520 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.979853 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.980167 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.980479 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.980823 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.981143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.981454 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.981785 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.982101 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.982436 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.982738 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.983076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.983595 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.984620 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.985099 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.985567 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.986068 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.986519 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.986954 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.987419 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.987742 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.988062 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.988388 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.988737 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.989057 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.989372 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.989693 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.990013 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.990327 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.990646 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.990960 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.991298 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.991674 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.992004 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.992319 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.992654 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.992994 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.993312 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.993626 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.993941 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.994261 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.994579 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.994898 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.995210 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.995532 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.995845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.996165 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.996525 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.996882 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.997198 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.997511 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.997835 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.998155 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.998488 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.998806 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:55.999125 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.000076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.000672 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.001241 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.001587 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.001920 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.002269 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.002615 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.002933 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.003249 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.003563 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.003899 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.004152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.context [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d98c4119-3b5c-4544-98c3-1189517bc4f8(cell1) {{(pid=129687) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 14:54:56.004328 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.004525 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.004871 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.005191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.005508 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.005824 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.006140 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.006456 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.006772 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.007085 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.007400 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.007714 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.008029 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.008194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:54:56.008359 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.008703 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.009038 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.009363 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.009687 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.009825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:54:56.010013 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.010330 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.010622 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:54:56.010720 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.010950 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.011266 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.011588 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.011923 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.012244 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.012550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:54:56.012670 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.013209 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.013563 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.013859 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.014189 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.014517 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.014662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO dbcounter [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Registered counter for database nova_cell0 Jun 27 14:54:56.014848 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.015347 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.015843 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.016181 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.016508 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.016968 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO dbcounter [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Registered counter for database nova_cell1 Jun 27 14:54:56.027897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.027897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.028512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.028512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.028512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.028512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.028512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.028512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.028512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.028512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_db.sqlalchemy.engines [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:54:56.029829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.029829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.030334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_db.sqlalchemy.engines [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:54:56.030418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.030418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.030418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.030418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.030418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.030418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.030418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.030418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.031057 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.031057 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.031359 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.031786 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.032106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writer thread running {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:54:56.032272 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.032437 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.032871 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.033193 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.033532 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.033865 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.034199 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.034596 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.034916 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.035256 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.035598 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.035896 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.036222 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.036540 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.036894 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.037218 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.037541 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.037876 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.038211 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.038592 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.038930 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.039262 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.039618 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.039940 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.040293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.040632 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.040979 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.041302 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.041618 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:54:56.041867 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 14:54:56.107191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO dbcounter [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Registered counter for database nova_api Jun 27 14:54:56.129089 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_db.sqlalchemy.engines [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:54:56.135635 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writer thread running {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:54:56.171099 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writer thread running {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:54:56.181856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO dbcounter [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Registered counter for database nova_cell0 Jun 27 14:54:56.189085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_db.sqlalchemy.engines [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:54:56.193725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writer thread running {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:54:56.203028 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.context [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d98c4119-3b5c-4544-98c3-1189517bc4f8(cell1) {{(pid=129686) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 14:54:56.207237 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:54:56.208890 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:54:56.209705 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:54:56.211661 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:54:56.213681 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO dbcounter [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Registered counter for database nova_cell0 Jun 27 14:54:56.217762 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO dbcounter [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Registered counter for database nova_cell1 Jun 27 14:54:56.225359 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_db.sqlalchemy.engines [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:54:56.227129 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_db.sqlalchemy.engines [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:54:56.232689 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writer thread running {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:54:56.236285 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writer thread running {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:54:56.388039 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO dbcounter [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Registered counter for database nova_cell0 Jun 27 14:54:56.394794 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_db.sqlalchemy.engines [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:54:56.399127 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writer thread running {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:54:56.510682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: WARNING keystonemiddleware.auth_token [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 14:54:56.518260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: WARNING keystonemiddleware.auth_token [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 14:54:56.738783 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: WARNING keystonemiddleware.auth_token [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 14:54:56.746501 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: WARNING keystonemiddleware.auth_token [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 14:54:56.861245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: WARNING keystonemiddleware.auth_token [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 14:54:56.865907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: WARNING keystonemiddleware.auth_token [None req-924b9ddc-71f0-41d4-9961-020650e946f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 14:54:56.871197 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c46f97e9c0 pid: 129687 (default app) Jun 27 14:54:57.104473 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: WARNING keystonemiddleware.auth_token [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 14:54:57.107220 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: WARNING keystonemiddleware.auth_token [None req-e4618a7b-4f19-4df5-9a01-a53ba6793773 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 14:54:57.113542 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c46f97e9c0 pid: 129686 (default app) Jun 27 14:55:50.900374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:50.901446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:50.902389 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:50.903599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:52.112391 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ce96921d-39a9-4b0b-8da3-d90da01905a4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: .version_select at 0x7f13fba4d790>, body: {"keypair": {"name": "tempest-keypair-653289847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIq79mPpQm/+/9wDbHiljC+mcqEgRpTUoNiOZjpQ7K+fzOVb/32obqtRQjxFwmj1t+dlauoabiySy9cI0LKGTNaJGwypMvoaHJZdm2FAAD1AJ7pyrJPEAuk5Xo7tFtANw=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:55:52.168481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-ce96921d-39a9-4b0b-8da3-d90da01905a4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for project 3d96ee908883411d9838f850ee7dd66b. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:55:52.184100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-ce96921d-39a9-4b0b-8da3-d90da01905a4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for user d93abd4361d240919ec85cf4b92347fb and project 3d96ee908883411d9838f850ee7dd66b. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:55:52.378418 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ce96921d-39a9-4b0b-8da3-d90da01905a4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.493106 Jun 27 14:55:52.381560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 14:55:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:55:54.350013 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_api:SELECT=3 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:54.351670 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=3 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:54.352772 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=3 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:54.376618 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=3 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:55.812952 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-f57a26cb-d314-4ad2-ab20-895c03e08a8c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'create', calling method: .version_select at 0x7f13fba4d790>, body: {"keypair": {"name": "tempest-keypair-640797940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfMey+jQv8efz/WiY0w8bnclpj/s/STvK8ywCJwXGXnq3q2J0KCx40SBuXgC8CLw7EmlEyzXP5uh85T+IaGzCmfoydMcfpKyI8Wih+gR0wkzdWn9FMI7YD8jyoKIHzY+g=="}} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:55:55.990474 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-f57a26cb-d314-4ad2-ab20-895c03e08a8c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Getting quotas for project 93e1b27eb6724262b7a128c8412642d6. Resources: {'key_pairs'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:55:56.010492 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-f57a26cb-d314-4ad2-ab20-895c03e08a8c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Getting quotas for user 29e7fc2290a641bcb6f1f96501f98d69 and project 93e1b27eb6724262b7a128c8412642d6. Resources: {'key_pairs'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:55:56.289680 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-f57a26cb-d314-4ad2-ab20-895c03e08a8c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.945206 Jun 27 14:55:56.290448 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 1/2] 10.222.0.44 () {62 vars in 1199 bytes} [Mon Jun 27 14:55:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1948 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 14:55:58.717734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1420834985", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a5eed5b-e23d-40b2-b9c3-11f70e365ab5"}], "security_groups": [{"name": "tempest-securitygroup--616230022"}], "key_name": "tempest-keypair-653289847", "user_data": "}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:55:59.505687 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1270534950", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:55:59.947538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] validate_networks() for [('5a5eed5b-e23d-40b2-b9c3-11f70e365ab5', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:56:00.003652 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.network.neutron [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] validate_networks() for [('def18f2b-1d12-479c-a792-7c04bf3096cb', None, None, None, None, None)] {{(pid=129686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:56:01.418005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:56:01.418455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:56:01.418939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:56:01.426274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:56:01.426274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:56:01.429962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:01.430604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:01.431559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:01.432175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:01.467089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for project 3d96ee908883411d9838f850ee7dd66b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:56:01.477768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for user d93abd4361d240919ec85cf4b92347fb and project 3d96ee908883411d9838f850ee7dd66b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:56:01.499395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:56:01.502443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:56:01.744510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f7d5a7a9-fa83-463c-9fb3-d103ee2e1a33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.037041 Jun 27 14:56:01.752382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 2/3] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:55:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 3045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 14:56:01.896664 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Flavor limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:56:01.897835 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Image limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:56:01.898492 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Flavor pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:56:01.899071 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Image pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:56:01.900573 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:56:01.922847 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:01.923748 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:01.924894 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:01.925555 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:01.959705 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Getting quotas for project c73553ee127a469b9cad0eda54e8c4a2. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:56:01.965309 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Getting quotas for user 27b0e2428571450ea1d5edfd1c3b0f80 and project c73553ee127a469b9cad0eda54e8c4a2. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:56:02.012417 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Going to run 1 instances... {{(pid=129686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:56:02.017731 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:56:02.213783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1854161614", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "networks": [{"uuid": "ec2295aa-cf82-4577-92e5-819b8f738056"}]}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:02.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4b620544-e1ff-4e4b-a696-45315aebf84e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.924521 Jun 27 14:56:02.228247 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 2/4] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:55:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 14:56:02.240336 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e4678511-65bc-478f-9a34-19a419fe3d21 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:02.249679 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e4678511-65bc-478f-9a34-19a419fe3d21 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:02.314248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] validate_networks() for [('ec2295aa-cf82-4577-92e5-819b8f738056', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:56:02.485453 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e4678511-65bc-478f-9a34-19a419fe3d21 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:02.536183 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e4678511-65bc-478f-9a34-19a419fe3d21 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1241 microversion: 2.1 time: 0.306371 Jun 27 14:56:02.541655 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 3/5] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:02 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1241 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:02.561201 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-805510b5-bd12-4037-8c6a-3079fd03f2ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:02.561201 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-805510b5-bd12-4037-8c6a-3079fd03f2ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:02.741518 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-805510b5-bd12-4037-8c6a-3079fd03f2ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:02.749176 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-805510b5-bd12-4037-8c6a-3079fd03f2ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1222 microversion: 2.1 time: 0.206153 Jun 27 14:56:02.749765 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 4/6] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:02 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1222 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:02.782188 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2117841492", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc63a8c7-0e5b-4561-8e04-9bbfbecdaeb8"}], "security_groups": [{"name": "tempest-securitygroup--601420245"}], "key_name": "tempest-keypair-640797940", "user_data": "}} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:03.006513 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.network.neutron [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] validate_networks() for [('cc63a8c7-0e5b-4561-8e04-9bbfbecdaeb8', None, None, None, None, None)] {{(pid=129686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:56:03.407227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:56:03.408333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:56:03.409110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:56:03.409826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:56:03.410304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:56:03.424360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:03.424360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:03.424360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:03.424957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:03.461440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Getting quotas for project 27b7c4f8156b409785b5555712cdc934. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:56:03.472407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Getting quotas for user 340af9c8b53a483d9fc311b36736ca01 and project 27b7c4f8156b409785b5555712cdc934. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:56:03.506082 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:56:03.508233 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:56:03.696559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cb2a8db3-53dd-41fd-bafa-327baf914cad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.941686 Jun 27 14:56:03.698882 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Flavor limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:56:03.699569 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Image limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:56:03.700478 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Flavor pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:56:03.701191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 3/7] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:56:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 14:56:03.701831 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Image pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:56:03.702592 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:56:03.713354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-639283521", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:03.761647 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:03.762877 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:03.765657 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:03.767970 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:03.831548 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Getting quotas for project 93e1b27eb6724262b7a128c8412642d6. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:56:03.838127 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Getting quotas for user 29e7fc2290a641bcb6f1f96501f98d69 and project 93e1b27eb6724262b7a128c8412642d6. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:56:03.859074 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Going to run 1 instances... {{(pid=129686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:56:03.861412 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:56:03.874598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] validate_networks() for [('def18f2b-1d12-479c-a792-7c04bf3096cb', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:56:04.065724 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-39912fcc-d2e1-4ae2-80b5-9d8bf7da70ce tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.314834 Jun 27 14:56:04.072167 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 5/8] 10.222.0.44 () {62 vars in 1187 bytes} [Mon Jun 27 14:56:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 14:56:04.088928 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d3f87652-3f55-4c57-9a6b-6e30b738501e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:04.090777 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d3f87652-3f55-4c57-9a6b-6e30b738501e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:04.221070 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d3f87652-3f55-4c57-9a6b-6e30b738501e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:04.233931 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d3f87652-3f55-4c57-9a6b-6e30b738501e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1241 microversion: 2.1 time: 0.153704 Jun 27 14:56:04.235032 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 6/9] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:04 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1241 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:04.261824 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9e0e4997-3304-4b70-a3b7-c52ff8212dd4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:04.262470 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-9e0e4997-3304-4b70-a3b7-c52ff8212dd4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:04.411365 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9e0e4997-3304-4b70-a3b7-c52ff8212dd4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:04.427966 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-9e0e4997-3304-4b70-a3b7-c52ff8212dd4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1215 microversion: 2.1 time: 0.182706 Jun 27 14:56:04.431613 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 7/10] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:04 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:04.450053 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-dfa0b6a5-0c60-48f1-93be-fbcf0e8ba9b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:04.454020 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-dfa0b6a5-0c60-48f1-93be-fbcf0e8ba9b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:04.588705 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-dfa0b6a5-0c60-48f1-93be-fbcf0e8ba9b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:04.601444 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-dfa0b6a5-0c60-48f1-93be-fbcf0e8ba9b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:04.604883 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-dfa0b6a5-0c60-48f1-93be-fbcf0e8ba9b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:04.610503 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-dfa0b6a5-0c60-48f1-93be-fbcf0e8ba9b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1281 microversion: 2.20 time: 0.167998 Jun 27 14:56:04.611495 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 8/11] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:04 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1281 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:04.659925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:56:04.660408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:56:04.660854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:56:04.661564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:56:04.662158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:56:04.671922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:04.672380 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:04.673223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:04.673666 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:04.692708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Getting quotas for project c73553ee127a469b9cad0eda54e8c4a2. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:56:04.696757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Getting quotas for user 27b0e2428571450ea1d5edfd1c3b0f80 and project c73553ee127a469b9cad0eda54e8c4a2. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:56:04.708291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:56:04.710443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:56:04.974496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d17ec1b5-66f7-45d5-b1c2-0e63e20b8c37 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.270589 Jun 27 14:56:04.986476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 4/12] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:56:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 14:56:04.999392 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6cb22a97-b73d-4a29-b6a8-9f3ce7fe8066 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:05.003493 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6cb22a97-b73d-4a29-b6a8-9f3ce7fe8066 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:05.092812 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6cb22a97-b73d-4a29-b6a8-9f3ce7fe8066 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:05.110654 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6cb22a97-b73d-4a29-b6a8-9f3ce7fe8066 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1221 microversion: 2.1 time: 0.122496 Jun 27 14:56:05.111038 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 9/13] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:04 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:05.251446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-63e6ec40-4d7a-42bb-88b1-99cd3595c3b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:05.418629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-63e6ec40-4d7a-42bb-88b1-99cd3595c3b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:05.418629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-63e6ec40-4d7a-42bb-88b1-99cd3595c3b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:05.418629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-63e6ec40-4d7a-42bb-88b1-99cd3595c3b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:05.418629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-63e6ec40-4d7a-42bb-88b1-99cd3595c3b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:05.420068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-63e6ec40-4d7a-42bb-88b1-99cd3595c3b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:05.420068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-63e6ec40-4d7a-42bb-88b1-99cd3595c3b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:05.427928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-63e6ec40-4d7a-42bb-88b1-99cd3595c3b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1245 microversion: 2.1 time: 0.180325 Jun 27 14:56:05.428492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 5/14] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:05 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1245 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:05.447278 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6e3206bf-5ee6-4c9f-be89-e09de748ebc7 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:05.447884 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6e3206bf-5ee6-4c9f-be89-e09de748ebc7 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:05.499413 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6e3206bf-5ee6-4c9f-be89-e09de748ebc7 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:05.506038 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6e3206bf-5ee6-4c9f-be89-e09de748ebc7 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1215 microversion: 2.1 time: 0.062546 Jun 27 14:56:05.542188 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 10/15] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:05 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:05.629523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6720d343-26a5-49c9-b189-a9130292026b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:05.633291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6720d343-26a5-49c9-b189-a9130292026b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:05.691501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6720d343-26a5-49c9-b189-a9130292026b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:05.705893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6720d343-26a5-49c9-b189-a9130292026b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:05.707599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6720d343-26a5-49c9-b189-a9130292026b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:05.708757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6720d343-26a5-49c9-b189-a9130292026b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1281 microversion: 2.20 time: 0.083831 Jun 27 14:56:05.709434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 6/16] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:05 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:06.128016 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-fa5b1c42-69ff-41d4-b3e1-d43c191748ce tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:06.130448 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-fa5b1c42-69ff-41d4-b3e1-d43c191748ce tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:06.183410 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fa5b1c42-69ff-41d4-b3e1-d43c191748ce tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:06.195508 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-fa5b1c42-69ff-41d4-b3e1-d43c191748ce tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1221 microversion: 2.1 time: 0.071258 Jun 27 14:56:06.199478 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 11/17] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:06 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:06.445048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-28fe509f-8b62-4ca5-b705-e807b7e4f1f1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:06.445654 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-28fe509f-8b62-4ca5-b705-e807b7e4f1f1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:06.452117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-28fe509f-8b62-4ca5-b705-e807b7e4f1f1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:06.455979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-28fe509f-8b62-4ca5-b705-e807b7e4f1f1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:06.455979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-28fe509f-8b62-4ca5-b705-e807b7e4f1f1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:06.455979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-28fe509f-8b62-4ca5-b705-e807b7e4f1f1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:06.524556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-28fe509f-8b62-4ca5-b705-e807b7e4f1f1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:06.533274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-28fe509f-8b62-4ca5-b705-e807b7e4f1f1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1245 microversion: 2.1 time: 0.092462 Jun 27 14:56:06.533848 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 7/18] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:06 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:06.549803 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-2ee01a7e-2b48-49d2-aa2e-d74abc25c8bc tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:06.550702 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-2ee01a7e-2b48-49d2-aa2e-d74abc25c8bc tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:06.557026 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2ee01a7e-2b48-49d2-aa2e-d74abc25c8bc tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:06.557662 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2ee01a7e-2b48-49d2-aa2e-d74abc25c8bc tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:06.558866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2ee01a7e-2b48-49d2-aa2e-d74abc25c8bc tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:06.559473 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2ee01a7e-2b48-49d2-aa2e-d74abc25c8bc tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:06.733174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:06.734715 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:06.748593 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:06.752934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:06.758774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:06.761359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:06.791870 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-2ee01a7e-2b48-49d2-aa2e-d74abc25c8bc tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:06.804055 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-2ee01a7e-2b48-49d2-aa2e-d74abc25c8bc tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1219 microversion: 2.1 time: 0.258031 Jun 27 14:56:06.805031 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 12/19] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:06 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1219 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:06.856031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:06.869015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:06.870674 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:06.873021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0e625dcb-f4f9-485d-92de-8ce3bac252f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1285 microversion: 2.20 time: 0.150189 Jun 27 14:56:06.873681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 8/20] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:06 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:07.212895 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-72b2ad4f-15b6-4dcd-b303-e59329246718 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:07.213447 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-72b2ad4f-15b6-4dcd-b303-e59329246718 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:07.219720 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-72b2ad4f-15b6-4dcd-b303-e59329246718 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:07.220169 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-72b2ad4f-15b6-4dcd-b303-e59329246718 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:07.221097 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-72b2ad4f-15b6-4dcd-b303-e59329246718 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:07.221541 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-72b2ad4f-15b6-4dcd-b303-e59329246718 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:07.284191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-72b2ad4f-15b6-4dcd-b303-e59329246718 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:07.291640 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-72b2ad4f-15b6-4dcd-b303-e59329246718 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1225 microversion: 2.1 time: 0.082464 Jun 27 14:56:07.292689 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 13/21] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:07 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:07.550542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ccfa0d0c-1b74-4057-907b-b7d4a95e5d5f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:07.551236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ccfa0d0c-1b74-4057-907b-b7d4a95e5d5f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:07.557205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ccfa0d0c-1b74-4057-907b-b7d4a95e5d5f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:07.557743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ccfa0d0c-1b74-4057-907b-b7d4a95e5d5f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:07.558559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ccfa0d0c-1b74-4057-907b-b7d4a95e5d5f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:07.559092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ccfa0d0c-1b74-4057-907b-b7d4a95e5d5f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:07.618981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ccfa0d0c-1b74-4057-907b-b7d4a95e5d5f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:07.627085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ccfa0d0c-1b74-4057-907b-b7d4a95e5d5f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1245 microversion: 2.1 time: 0.080597 Jun 27 14:56:07.627883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 9/22] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:07 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:07.824005 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-81597586-89b8-4c72-84b2-9e343a358c24 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:07.824635 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-81597586-89b8-4c72-84b2-9e343a358c24 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:07.831889 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-81597586-89b8-4c72-84b2-9e343a358c24 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:07.832615 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-81597586-89b8-4c72-84b2-9e343a358c24 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:07.833436 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-81597586-89b8-4c72-84b2-9e343a358c24 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:07.833880 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-81597586-89b8-4c72-84b2-9e343a358c24 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:07.890693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:07.891377 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:07.903255 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-81597586-89b8-4c72-84b2-9e343a358c24 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:07.911216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:07.911673 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:07.912480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:07.912830 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-81597586-89b8-4c72-84b2-9e343a358c24 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1219 microversion: 2.1 time: 0.094509 Jun 27 14:56:07.912973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:07.923191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 14/23] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:07 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:07.999768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:07.999768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:08.001072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:08.002506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b4547e89-6da5-47c9-855f-cd3c7705a671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1285 microversion: 2.20 time: 0.116386 Jun 27 14:56:08.003974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 10/24] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:07 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:08.308304 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-b0c4d939-9e11-4c3e-88d6-fb601928ccfb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:08.309715 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-b0c4d939-9e11-4c3e-88d6-fb601928ccfb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:08.316244 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b0c4d939-9e11-4c3e-88d6-fb601928ccfb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:08.316710 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b0c4d939-9e11-4c3e-88d6-fb601928ccfb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:08.317467 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b0c4d939-9e11-4c3e-88d6-fb601928ccfb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:08.317934 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b0c4d939-9e11-4c3e-88d6-fb601928ccfb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:08.418749 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-b0c4d939-9e11-4c3e-88d6-fb601928ccfb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:08.427447 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-b0c4d939-9e11-4c3e-88d6-fb601928ccfb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1217 microversion: 2.1 time: 0.123034 Jun 27 14:56:08.428401 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 15/25] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:08 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:08.644665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-59a22ebe-d2ab-47a9-9016-2d438fa8b730 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:08.645310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-59a22ebe-d2ab-47a9-9016-2d438fa8b730 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:08.651404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-59a22ebe-d2ab-47a9-9016-2d438fa8b730 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:08.651860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-59a22ebe-d2ab-47a9-9016-2d438fa8b730 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:08.652676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-59a22ebe-d2ab-47a9-9016-2d438fa8b730 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:08.653122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-59a22ebe-d2ab-47a9-9016-2d438fa8b730 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:08.726718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-59a22ebe-d2ab-47a9-9016-2d438fa8b730 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:08.734827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-59a22ebe-d2ab-47a9-9016-2d438fa8b730 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1293 microversion: 2.1 time: 0.094332 Jun 27 14:56:08.735409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 11/26] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:08 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:08.929597 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-8c6b7c28-b885-4892-a362-9b097e541d43 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:08.930214 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-8c6b7c28-b885-4892-a362-9b097e541d43 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:08.936778 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8c6b7c28-b885-4892-a362-9b097e541d43 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:08.937239 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8c6b7c28-b885-4892-a362-9b097e541d43 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:08.938032 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8c6b7c28-b885-4892-a362-9b097e541d43 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:08.938554 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8c6b7c28-b885-4892-a362-9b097e541d43 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:09.019631 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-8c6b7c28-b885-4892-a362-9b097e541d43 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:09.023737 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:09.033843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:09.033971 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-8c6b7c28-b885-4892-a362-9b097e541d43 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1267 microversion: 2.1 time: 0.103916 Jun 27 14:56:09.033971 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 16/27] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:08 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:09.034115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:09.034115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:09.034115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:09.034470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:09.114966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:09.123670 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:09.125668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:09.126290 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-00784518-45af-4a4d-a895-e319c6f6b509 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1333 microversion: 2.20 time: 0.106894 Jun 27 14:56:09.126847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 12/28] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:09 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1333 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:09.446579 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-456e7a97-2ba9-43b8-a2f3-62888084746e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:09.447712 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-456e7a97-2ba9-43b8-a2f3-62888084746e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:09.454642 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-456e7a97-2ba9-43b8-a2f3-62888084746e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:09.455301 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-456e7a97-2ba9-43b8-a2f3-62888084746e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:09.456197 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-456e7a97-2ba9-43b8-a2f3-62888084746e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:09.456910 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-456e7a97-2ba9-43b8-a2f3-62888084746e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:09.522860 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-456e7a97-2ba9-43b8-a2f3-62888084746e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:09.534410 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-456e7a97-2ba9-43b8-a2f3-62888084746e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1273 microversion: 2.1 time: 0.092238 Jun 27 14:56:09.535174 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 17/29] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:09 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:09.753550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-40590fca-3d8c-49f3-873a-6e8b7d842889 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:09.754186 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-40590fca-3d8c-49f3-873a-6e8b7d842889 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:09.761607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40590fca-3d8c-49f3-873a-6e8b7d842889 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:09.762055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40590fca-3d8c-49f3-873a-6e8b7d842889 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:09.763467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40590fca-3d8c-49f3-873a-6e8b7d842889 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:09.763910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40590fca-3d8c-49f3-873a-6e8b7d842889 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:09.829018 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-40590fca-3d8c-49f3-873a-6e8b7d842889 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:09.839992 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-40590fca-3d8c-49f3-873a-6e8b7d842889 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1293 microversion: 2.1 time: 0.090863 Jun 27 14:56:09.840571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 13/30] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:09 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:10.047864 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-61404c67-c5a8-411e-bfdb-526ec748d0ca tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:10.048482 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-61404c67-c5a8-411e-bfdb-526ec748d0ca tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:10.056137 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-61404c67-c5a8-411e-bfdb-526ec748d0ca tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:10.056997 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-61404c67-c5a8-411e-bfdb-526ec748d0ca tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:10.057773 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-61404c67-c5a8-411e-bfdb-526ec748d0ca tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:10.058538 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-61404c67-c5a8-411e-bfdb-526ec748d0ca tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:10.145178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:10.145851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:10.157675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:10.158136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:10.158926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:10.159369 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:10.172687 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-61404c67-c5a8-411e-bfdb-526ec748d0ca tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:10.192906 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-61404c67-c5a8-411e-bfdb-526ec748d0ca tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1267 microversion: 2.1 time: 0.147103 Jun 27 14:56:10.192906 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 18/31] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:10 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:10.247981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:10.260706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:10.262374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:10.263534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-437f23b1-8a1b-47bc-b3dd-217e2c5cce98 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1333 microversion: 2.20 time: 0.123015 Jun 27 14:56:10.264684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 14/32] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:10 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:10.551495 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4368311d-fded-4c42-833e-a742c513cd49 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:10.552130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4368311d-fded-4c42-833e-a742c513cd49 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:10.558107 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4368311d-fded-4c42-833e-a742c513cd49 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:10.558823 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4368311d-fded-4c42-833e-a742c513cd49 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:10.559627 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4368311d-fded-4c42-833e-a742c513cd49 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:10.560054 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4368311d-fded-4c42-833e-a742c513cd49 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:10.622802 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4368311d-fded-4c42-833e-a742c513cd49 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:10.630629 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4368311d-fded-4c42-833e-a742c513cd49 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1273 microversion: 2.1 time: 0.083009 Jun 27 14:56:10.631375 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 19/33] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:10 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:10.856190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ba521ff4-a62c-4ac2-be70-bd4ba8bf175b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:10.856969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ba521ff4-a62c-4ac2-be70-bd4ba8bf175b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:10.863293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ba521ff4-a62c-4ac2-be70-bd4ba8bf175b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:10.863904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ba521ff4-a62c-4ac2-be70-bd4ba8bf175b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:10.864984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ba521ff4-a62c-4ac2-be70-bd4ba8bf175b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:10.865429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ba521ff4-a62c-4ac2-be70-bd4ba8bf175b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:10.927089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ba521ff4-a62c-4ac2-be70-bd4ba8bf175b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:10.934922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ba521ff4-a62c-4ac2-be70-bd4ba8bf175b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1293 microversion: 2.1 time: 0.082125 Jun 27 14:56:10.935552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 15/34] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:10 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:11.208690 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c0c4a98c-abd6-4c4b-b348-1cd842ed8b5b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:11.212988 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c0c4a98c-abd6-4c4b-b348-1cd842ed8b5b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:11.216755 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c0c4a98c-abd6-4c4b-b348-1cd842ed8b5b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:11.217494 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c0c4a98c-abd6-4c4b-b348-1cd842ed8b5b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:11.218361 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c0c4a98c-abd6-4c4b-b348-1cd842ed8b5b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:11.218804 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c0c4a98c-abd6-4c4b-b348-1cd842ed8b5b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:11.281238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:11.282029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:11.284671 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c0c4a98c-abd6-4c4b-b348-1cd842ed8b5b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:11.288088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:11.288549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:11.293561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:11.293561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:11.294265 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c0c4a98c-abd6-4c4b-b348-1cd842ed8b5b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1267 microversion: 2.1 time: 0.089179 Jun 27 14:56:11.294658 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 20/35] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:11 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:11.351780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:11.360232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:11.361719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:11.368099 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2553178f-35bb-4e59-9e3c-01c3c1671ec4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1333 microversion: 2.20 time: 0.085648 Jun 27 14:56:11.368099 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 16/36] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:11 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:11.647683 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-ab915b11-a5f9-423f-b19e-4acc062202dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:11.648781 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-ab915b11-a5f9-423f-b19e-4acc062202dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:11.655189 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ab915b11-a5f9-423f-b19e-4acc062202dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:11.655744 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ab915b11-a5f9-423f-b19e-4acc062202dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:11.656498 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ab915b11-a5f9-423f-b19e-4acc062202dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:11.656953 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ab915b11-a5f9-423f-b19e-4acc062202dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:11.717688 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ab915b11-a5f9-423f-b19e-4acc062202dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:11.725446 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-ab915b11-a5f9-423f-b19e-4acc062202dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1273 microversion: 2.1 time: 0.081675 Jun 27 14:56:11.726004 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 21/37] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:11 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1273 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:11.951889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8fd18f79-f0b2-4d69-9c17-0cb04fa9078e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:11.952494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8fd18f79-f0b2-4d69-9c17-0cb04fa9078e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:11.958581 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8fd18f79-f0b2-4d69-9c17-0cb04fa9078e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:11.959026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8fd18f79-f0b2-4d69-9c17-0cb04fa9078e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:11.959806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8fd18f79-f0b2-4d69-9c17-0cb04fa9078e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:11.960240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8fd18f79-f0b2-4d69-9c17-0cb04fa9078e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:12.022906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8fd18f79-f0b2-4d69-9c17-0cb04fa9078e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:12.030904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8fd18f79-f0b2-4d69-9c17-0cb04fa9078e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1293 microversion: 2.1 time: 0.082944 Jun 27 14:56:12.031460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 17/38] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:11 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:12.312418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6c2d6b3c-5c7f-4aaa-a63f-2faf7f4161af tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:12.313074 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6c2d6b3c-5c7f-4aaa-a63f-2faf7f4161af tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:12.316332 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:12.319764 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c2d6b3c-5c7f-4aaa-a63f-2faf7f4161af tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:12.320211 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c2d6b3c-5c7f-4aaa-a63f-2faf7f4161af tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:12.320996 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c2d6b3c-5c7f-4aaa-a63f-2faf7f4161af tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:12.321433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c2d6b3c-5c7f-4aaa-a63f-2faf7f4161af tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:12.381493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:12.382249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:12.389315 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:12.392202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:12.392202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:12.392202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:12.392675 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6c2d6b3c-5c7f-4aaa-a63f-2faf7f4161af tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:12.399907 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6c2d6b3c-5c7f-4aaa-a63f-2faf7f4161af tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1267 microversion: 2.1 time: 0.093403 Jun 27 14:56:12.400470 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 22/39] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:12 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:12.458407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:12.469206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:12.471490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:12.472634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-542b1eb4-64b5-4d54-87eb-894f81c923ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1333 microversion: 2.20 time: 0.095128 Jun 27 14:56:12.482870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 18/40] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:12 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:12.744255 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-ee977e1b-8ab2-46e9-b79c-99fcd3c1e5cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:12.745296 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-ee977e1b-8ab2-46e9-b79c-99fcd3c1e5cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:12.752592 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ee977e1b-8ab2-46e9-b79c-99fcd3c1e5cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:12.753057 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ee977e1b-8ab2-46e9-b79c-99fcd3c1e5cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:12.754523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ee977e1b-8ab2-46e9-b79c-99fcd3c1e5cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:12.754963 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ee977e1b-8ab2-46e9-b79c-99fcd3c1e5cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:12.824524 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ee977e1b-8ab2-46e9-b79c-99fcd3c1e5cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:12.832708 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-ee977e1b-8ab2-46e9-b79c-99fcd3c1e5cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1281 microversion: 2.1 time: 0.093147 Jun 27 14:56:12.833284 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 23/41] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:12 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:13.048863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7ee1d2c6-32c4-4175-8ccf-1bc3da829b4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:13.049486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7ee1d2c6-32c4-4175-8ccf-1bc3da829b4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:13.055476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ee1d2c6-32c4-4175-8ccf-1bc3da829b4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:13.055936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ee1d2c6-32c4-4175-8ccf-1bc3da829b4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:13.056905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ee1d2c6-32c4-4175-8ccf-1bc3da829b4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:13.062969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ee1d2c6-32c4-4175-8ccf-1bc3da829b4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:13.250791 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7ee1d2c6-32c4-4175-8ccf-1bc3da829b4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:13.260155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7ee1d2c6-32c4-4175-8ccf-1bc3da829b4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1301 microversion: 2.1 time: 0.216076 Jun 27 14:56:13.275413 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 19/42] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:13 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1301 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:13.426451 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d00ff32f-4294-4292-a52c-353173d621fa tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:13.427247 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d00ff32f-4294-4292-a52c-353173d621fa tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:13.443710 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d00ff32f-4294-4292-a52c-353173d621fa tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:13.444371 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d00ff32f-4294-4292-a52c-353173d621fa tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:13.446405 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d00ff32f-4294-4292-a52c-353173d621fa tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:13.447051 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d00ff32f-4294-4292-a52c-353173d621fa tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:13.491303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:13.491805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:13.502138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:13.502597 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:13.503476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:13.503875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:13.611009 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d00ff32f-4294-4292-a52c-353173d621fa tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:13.626180 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d00ff32f-4294-4292-a52c-353173d621fa tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1285 microversion: 2.1 time: 0.207901 Jun 27 14:56:13.628743 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 24/43] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:13 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:13.677748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:13.695564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:13.701632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:13.706524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c5b6469a-5ebc-4283-893e-5583be99cea0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1341 microversion: 2.20 time: 0.219088 Jun 27 14:56:13.710717 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 20/44] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:13 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1341 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:13.858948 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-325b9e9c-ab54-4cdb-9ebd-b11c5bab8c84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:13.860893 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-325b9e9c-ab54-4cdb-9ebd-b11c5bab8c84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:13.881391 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=4 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:13.892023 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-325b9e9c-ab54-4cdb-9ebd-b11c5bab8c84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:13.892562 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-325b9e9c-ab54-4cdb-9ebd-b11c5bab8c84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:13.894455 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-325b9e9c-ab54-4cdb-9ebd-b11c5bab8c84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:13.905898 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-325b9e9c-ab54-4cdb-9ebd-b11c5bab8c84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:14.126269 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-325b9e9c-ab54-4cdb-9ebd-b11c5bab8c84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:14.137255 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-325b9e9c-ab54-4cdb-9ebd-b11c5bab8c84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1279 microversion: 2.1 time: 0.285362 Jun 27 14:56:14.163486 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 25/45] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:13 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1279 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:14.295544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c5871534-1518-44e0-8d46-709bbc00b55c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:14.296089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c5871534-1518-44e0-8d46-709bbc00b55c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:14.313587 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5871534-1518-44e0-8d46-709bbc00b55c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:14.314229 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5871534-1518-44e0-8d46-709bbc00b55c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:14.315149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5871534-1518-44e0-8d46-709bbc00b55c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:14.315722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5871534-1518-44e0-8d46-709bbc00b55c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:14.401413 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:14.483189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c5871534-1518-44e0-8d46-709bbc00b55c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:14.491994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c5871534-1518-44e0-8d46-709bbc00b55c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1299 microversion: 2.1 time: 0.203061 Jun 27 14:56:14.498091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 21/46] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:14 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:14.644851 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-590eb035-89da-45fd-ba75-e17693a69486 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:14.645773 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-590eb035-89da-45fd-ba75-e17693a69486 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:14.652789 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-590eb035-89da-45fd-ba75-e17693a69486 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:14.653882 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-590eb035-89da-45fd-ba75-e17693a69486 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:14.662685 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-590eb035-89da-45fd-ba75-e17693a69486 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:14.663156 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-590eb035-89da-45fd-ba75-e17693a69486 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:14.730996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:14.733736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:14.742709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=6 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:14.746751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:14.753759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:14.755525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:14.757090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:14.757535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:14.787634 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-590eb035-89da-45fd-ba75-e17693a69486 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:14.796256 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-590eb035-89da-45fd-ba75-e17693a69486 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1273 microversion: 2.1 time: 0.155256 Jun 27 14:56:14.806710 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 26/47] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:14 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:15.019213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:15.033844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:15.038996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:15.040164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a2005552-895b-4c1f-be83-a20ac5387958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1339 microversion: 2.20 time: 0.315539 Jun 27 14:56:15.048434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 22/48] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:14 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1339 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:15.172178 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-70d3d616-cc7e-457f-90d1-99f3848d2c9a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:15.174033 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-70d3d616-cc7e-457f-90d1-99f3848d2c9a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:15.199615 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-70d3d616-cc7e-457f-90d1-99f3848d2c9a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:15.200606 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-70d3d616-cc7e-457f-90d1-99f3848d2c9a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:15.201616 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-70d3d616-cc7e-457f-90d1-99f3848d2c9a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:15.202058 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-70d3d616-cc7e-457f-90d1-99f3848d2c9a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:15.511776 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-393deb2d-637d-42cc-858a-905a9026a6a0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:15.512887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-393deb2d-637d-42cc-858a-905a9026a6a0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:15.527876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-393deb2d-637d-42cc-858a-905a9026a6a0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:15.535539 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-393deb2d-637d-42cc-858a-905a9026a6a0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:15.538318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-393deb2d-637d-42cc-858a-905a9026a6a0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:15.539327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-393deb2d-637d-42cc-858a-905a9026a6a0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:15.700980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=24 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:16.190166 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=32 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:16.489115 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-70d3d616-cc7e-457f-90d1-99f3848d2c9a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:16.502158 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:16.521520 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-70d3d616-cc7e-457f-90d1-99f3848d2c9a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 1.352907 Jun 27 14:56:16.524602 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 27/49] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:15 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:16.529318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-393deb2d-637d-42cc-858a-905a9026a6a0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:16.540123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-393deb2d-637d-42cc-858a-905a9026a6a0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 1.031698 Jun 27 14:56:16.540745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 23/50] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:15 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:16.545525 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-ec5cf3d1-1bf1-431f-82c7-896b53880d65 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:16.546318 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-ec5cf3d1-1bf1-431f-82c7-896b53880d65 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:16.561444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:16.562892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:16.571180 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:16.571892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:16.572947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:16.573595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:16.607612 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ec5cf3d1-1bf1-431f-82c7-896b53880d65 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:16.608897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ec5cf3d1-1bf1-431f-82c7-896b53880d65 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:16.612137 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ec5cf3d1-1bf1-431f-82c7-896b53880d65 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:16.613703 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ec5cf3d1-1bf1-431f-82c7-896b53880d65 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:17.302469 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ec5cf3d1-1bf1-431f-82c7-896b53880d65 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:17.314142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:17.340080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:17.342014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:17.346179 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-ec5cf3d1-1bf1-431f-82c7-896b53880d65 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.820091 Jun 27 14:56:17.346781 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 28/51] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:16 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:17.353032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c7b65562-3f4c-42f3-958f-c7030eb9b480 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.810956 Jun 27 14:56:17.361850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 24/52] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:16 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:17.546406 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-89eff840-2067-4242-a644-5e4678f1e81d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:17.547207 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-89eff840-2067-4242-a644-5e4678f1e81d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:17.556257 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-89eff840-2067-4242-a644-5e4678f1e81d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:17.556784 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-89eff840-2067-4242-a644-5e4678f1e81d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:17.564300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-de313bc4-d4af-4ff1-bb87-346f7b385c3e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:17.568327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-de313bc4-d4af-4ff1-bb87-346f7b385c3e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:17.570801 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-89eff840-2067-4242-a644-5e4678f1e81d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:17.572406 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-89eff840-2067-4242-a644-5e4678f1e81d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:17.574073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de313bc4-d4af-4ff1-bb87-346f7b385c3e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:17.577329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de313bc4-d4af-4ff1-bb87-346f7b385c3e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:17.578730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de313bc4-d4af-4ff1-bb87-346f7b385c3e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:17.579482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de313bc4-d4af-4ff1-bb87-346f7b385c3e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:17.945874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-de313bc4-d4af-4ff1-bb87-346f7b385c3e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:17.968163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-de313bc4-d4af-4ff1-bb87-346f7b385c3e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.408400 Jun 27 14:56:17.975933 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 25/53] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:17 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:18.321096 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-89eff840-2067-4242-a644-5e4678f1e81d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:18.329917 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-89eff840-2067-4242-a644-5e4678f1e81d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.788577 Jun 27 14:56:18.330494 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 29/54] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:17 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:18.367390 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0efc8099-ed12-4264-aa8b-928f41b1477a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:18.368154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0efc8099-ed12-4264-aa8b-928f41b1477a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:18.376948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0efc8099-ed12-4264-aa8b-928f41b1477a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:18.377395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0efc8099-ed12-4264-aa8b-928f41b1477a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:18.378746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0efc8099-ed12-4264-aa8b-928f41b1477a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:18.379193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0efc8099-ed12-4264-aa8b-928f41b1477a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:18.379654 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:18.380374 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:18.387212 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:18.388744 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:18.390005 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:18.390954 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:18.626398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0efc8099-ed12-4264-aa8b-928f41b1477a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:18.636290 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0efc8099-ed12-4264-aa8b-928f41b1477a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.273924 Jun 27 14:56:18.638018 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 26/55] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:18 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:18.748883 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:18.769348 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:18.769348 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:18.769567 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-39d0ba45-cbf1-4337-a18e-50fa23f22748 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.393664 Jun 27 14:56:18.772731 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 30/56] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:18 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:18.846546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-5d7546d8-3bd9-439e-9e58-eb26427df562 req-fcce3134-b95c-4393-b2ff-a2ba01995a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b907368b-2875-4987-b99d-e0fea1a04ccb", "tag": "0c35fb63-bff3-4058-ae2f-0b7d051c6f76"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:18.869964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5d7546d8-3bd9-439e-9e58-eb26427df562 req-fcce3134-b95c-4393-b2ff-a2ba01995a1b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:18.871027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5d7546d8-3bd9-439e-9e58-eb26427df562 req-fcce3134-b95c-4393-b2ff-a2ba01995a1b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:18.897795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-5d7546d8-3bd9-439e-9e58-eb26427df562 req-fcce3134-b95c-4393-b2ff-a2ba01995a1b service nova] Creating event network-changed:0c35fb63-bff3-4058-ae2f-0b7d051c6f76 for instance b907368b-2875-4987-b99d-e0fea1a04ccb on hv-cinder-79760 Jun 27 14:56:18.898677 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5d7546d8-3bd9-439e-9e58-eb26427df562 req-fcce3134-b95c-4393-b2ff-a2ba01995a1b service nova] Acquired lock "compute-rpcapi-router" {{(pid=129687) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 14:56:18.900001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-932aa9d3-2a81-41b3-b028-ba896abb6df2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:18.900672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-932aa9d3-2a81-41b3-b028-ba896abb6df2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:18.901708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-932aa9d3-2a81-41b3-b028-ba896abb6df2 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:18.902407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-932aa9d3-2a81-41b3-b028-ba896abb6df2 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:18.913989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.compute.rpcapi [None req-932aa9d3-2a81-41b3-b028-ba896abb6df2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 14:56:18.915146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-932aa9d3-2a81-41b3-b028-ba896abb6df2 None None] Releasing lock "compute-rpcapi-router" {{(pid=129687) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 14:56:18.935775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-932aa9d3-2a81-41b3-b028-ba896abb6df2 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165375 Jun 27 14:56:18.937153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 27/57] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:56:18.989975 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c9573cb4-2cf8-480b-8678-cebfdbda8cdc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:18.990778 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c9573cb4-2cf8-480b-8678-cebfdbda8cdc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:19.000061 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c9573cb4-2cf8-480b-8678-cebfdbda8cdc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:19.001858 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c9573cb4-2cf8-480b-8678-cebfdbda8cdc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:19.002767 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c9573cb4-2cf8-480b-8678-cebfdbda8cdc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:19.004328 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c9573cb4-2cf8-480b-8678-cebfdbda8cdc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:19.348607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-23a795cd-414a-43cc-8e4e-bf597e013a7e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:19.349312 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-23a795cd-414a-43cc-8e4e-bf597e013a7e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:19.356784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23a795cd-414a-43cc-8e4e-bf597e013a7e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:19.357239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23a795cd-414a-43cc-8e4e-bf597e013a7e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:19.358002 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23a795cd-414a-43cc-8e4e-bf597e013a7e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:19.358430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23a795cd-414a-43cc-8e4e-bf597e013a7e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:19.395988 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c9573cb4-2cf8-480b-8678-cebfdbda8cdc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:19.407474 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c9573cb4-2cf8-480b-8678-cebfdbda8cdc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.421829 Jun 27 14:56:19.408699 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 31/58] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:18 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:19.511044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-23a795cd-414a-43cc-8e4e-bf597e013a7e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:19.518998 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-23a795cd-414a-43cc-8e4e-bf597e013a7e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.174700 Jun 27 14:56:19.521612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 28/59] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:19 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:19.655645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e5177fc0-092d-47a2-b78e-f0b9d11f5cbd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:19.656600 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e5177fc0-092d-47a2-b78e-f0b9d11f5cbd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:19.665731 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e5177fc0-092d-47a2-b78e-f0b9d11f5cbd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:19.666194 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e5177fc0-092d-47a2-b78e-f0b9d11f5cbd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:19.676132 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e5177fc0-092d-47a2-b78e-f0b9d11f5cbd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:19.677627 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e5177fc0-092d-47a2-b78e-f0b9d11f5cbd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:19.795045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:19.795045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:19.810761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:19.810761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:19.811359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:19.811806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:19.905905 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e5177fc0-092d-47a2-b78e-f0b9d11f5cbd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:19.914076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e5177fc0-092d-47a2-b78e-f0b9d11f5cbd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.263514 Jun 27 14:56:19.914688 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 32/60] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:19 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:20.110950 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-18230755-9193-42a4-8422-432d1634ea13 req-d807634d-6e0f-46a1-a97f-1f3884e12e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cebb517f-7c6e-4422-bd09-7bff9a8834ee", "tag": "0b060973-e116-470e-9bd4-728c1c0bb917"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:20.127521 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-18230755-9193-42a4-8422-432d1634ea13 req-d807634d-6e0f-46a1-a97f-1f3884e12e4c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:20.128206 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-18230755-9193-42a4-8422-432d1634ea13 req-d807634d-6e0f-46a1-a97f-1f3884e12e4c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:20.183409 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-18230755-9193-42a4-8422-432d1634ea13 req-d807634d-6e0f-46a1-a97f-1f3884e12e4c service nova] Creating event network-changed:0b060973-e116-470e-9bd4-728c1c0bb917 for instance cebb517f-7c6e-4422-bd09-7bff9a8834ee on hv-cinder-79760 Jun 27 14:56:20.183409 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-18230755-9193-42a4-8422-432d1634ea13 req-d807634d-6e0f-46a1-a97f-1f3884e12e4c service nova] Acquired lock "compute-rpcapi-router" {{(pid=129686) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 14:56:20.183409 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8b84e0ee-3f10-4497-a5b8-264c5b60c803 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:20.183409 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8b84e0ee-3f10-4497-a5b8-264c5b60c803 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:20.183409 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8b84e0ee-3f10-4497-a5b8-264c5b60c803 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:20.185305 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8b84e0ee-3f10-4497-a5b8-264c5b60c803 None None] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:20.185305 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.compute.rpcapi [None req-8b84e0ee-3f10-4497-a5b8-264c5b60c803 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 14:56:20.185305 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8b84e0ee-3f10-4497-a5b8-264c5b60c803 None None] Releasing lock "compute-rpcapi-router" {{(pid=129686) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 14:56:20.199438 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-8b84e0ee-3f10-4497-a5b8-264c5b60c803 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282933 Jun 27 14:56:20.201403 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 33/61] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:56:20.233781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:20.243615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:20.245249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:20.246396 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7ee53b07-c7e9-4af7-ae94-efd609127e81 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.461004 Jun 27 14:56:20.247754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 29/62] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:19 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:20.426670 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-86916133-7a6e-4842-a849-c95d2137484b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:20.426670 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-86916133-7a6e-4842-a849-c95d2137484b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:20.432241 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86916133-7a6e-4842-a849-c95d2137484b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:20.432721 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86916133-7a6e-4842-a849-c95d2137484b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:20.433480 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86916133-7a6e-4842-a849-c95d2137484b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:20.433916 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86916133-7a6e-4842-a849-c95d2137484b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:20.537485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d4efa447-ea48-4bea-9506-8b354839c18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:20.538308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d4efa447-ea48-4bea-9506-8b354839c18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:20.545389 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d4efa447-ea48-4bea-9506-8b354839c18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:20.545845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d4efa447-ea48-4bea-9506-8b354839c18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:20.546628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d4efa447-ea48-4bea-9506-8b354839c18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:20.547233 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d4efa447-ea48-4bea-9506-8b354839c18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:20.579666 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-86916133-7a6e-4842-a849-c95d2137484b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:20.589032 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-86916133-7a6e-4842-a849-c95d2137484b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.167994 Jun 27 14:56:20.589736 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 34/63] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:20 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:20.702218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d4efa447-ea48-4bea-9506-8b354839c18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:20.710177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d4efa447-ea48-4bea-9506-8b354839c18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.176615 Jun 27 14:56:20.719778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 30/64] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:20 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:20.933884 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-f9d94e0a-a9dc-47ff-bfa5-12d4954c7632 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:20.935394 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-f9d94e0a-a9dc-47ff-bfa5-12d4954c7632 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:20.959650 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f9d94e0a-a9dc-47ff-bfa5-12d4954c7632 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:20.960418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f9d94e0a-a9dc-47ff-bfa5-12d4954c7632 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:20.963702 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f9d94e0a-a9dc-47ff-bfa5-12d4954c7632 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:20.964484 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f9d94e0a-a9dc-47ff-bfa5-12d4954c7632 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:21.267914 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:21.269277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:21.280203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:21.281792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:21.283550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:21.285414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:21.393967 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-f9d94e0a-a9dc-47ff-bfa5-12d4954c7632 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:21.404335 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-f9d94e0a-a9dc-47ff-bfa5-12d4954c7632 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.474317 Jun 27 14:56:21.412601 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 35/65] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:20 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:21.511990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:21.522322 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:21.525559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:21.527627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cb23c401-6b7f-4f39-ad16-30da76fcc320 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.266325 Jun 27 14:56:21.538904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 31/66] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:21 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:21.613850 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-ec6880ba-3739-4d32-9a06-6cc3b34132f6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:21.615126 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-ec6880ba-3739-4d32-9a06-6cc3b34132f6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:21.623235 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ec6880ba-3739-4d32-9a06-6cc3b34132f6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:21.623961 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ec6880ba-3739-4d32-9a06-6cc3b34132f6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:21.625010 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ec6880ba-3739-4d32-9a06-6cc3b34132f6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:21.625781 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ec6880ba-3739-4d32-9a06-6cc3b34132f6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:21.727915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6c58942d-57a0-43e5-ad9e-d447ef690549 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:21.728831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6c58942d-57a0-43e5-ad9e-d447ef690549 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:21.737865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c58942d-57a0-43e5-ad9e-d447ef690549 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:21.743956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c58942d-57a0-43e5-ad9e-d447ef690549 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:21.745198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c58942d-57a0-43e5-ad9e-d447ef690549 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:21.745803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c58942d-57a0-43e5-ad9e-d447ef690549 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:21.838873 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ec6880ba-3739-4d32-9a06-6cc3b34132f6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:21.850252 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-ec6880ba-3739-4d32-9a06-6cc3b34132f6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.241588 Jun 27 14:56:21.852158 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 36/67] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:21 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:22.006944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6c58942d-57a0-43e5-ad9e-d447ef690549 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:22.017058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6c58942d-57a0-43e5-ad9e-d447ef690549 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.293071 Jun 27 14:56:22.018201 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 32/68] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:21 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:22.217250 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-f4ed8541-4e8d-4653-af51-572dc9aeb177 req-0aaf3db3-e40d-4897-a727-2cfa054bc958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fe8f1e-a283-4606-bc7f-fc3900da88fc", "tag": "4f50000a-d5a7-4cf4-a7ef-66f62c841dfe"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:22.238516 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-f4ed8541-4e8d-4653-af51-572dc9aeb177 req-0aaf3db3-e40d-4897-a727-2cfa054bc958 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:22.239439 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-f4ed8541-4e8d-4653-af51-572dc9aeb177 req-0aaf3db3-e40d-4897-a727-2cfa054bc958 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:22.253614 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-f4ed8541-4e8d-4653-af51-572dc9aeb177 req-0aaf3db3-e40d-4897-a727-2cfa054bc958 service nova] Creating event network-changed:4f50000a-d5a7-4cf4-a7ef-66f62c841dfe for instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc on hv-cinder-79760 Jun 27 14:56:22.259864 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-f4ed8541-4e8d-4653-af51-572dc9aeb177 req-0aaf3db3-e40d-4897-a727-2cfa054bc958 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047636 Jun 27 14:56:22.261139 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 37/69] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:56:22.422730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-de34c0b2-7cb3-4f9a-8e0d-04dc0a2ea869 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:22.424045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-de34c0b2-7cb3-4f9a-8e0d-04dc0a2ea869 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:22.432832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de34c0b2-7cb3-4f9a-8e0d-04dc0a2ea869 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:22.433369 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de34c0b2-7cb3-4f9a-8e0d-04dc0a2ea869 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:22.434504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de34c0b2-7cb3-4f9a-8e0d-04dc0a2ea869 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:22.435449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de34c0b2-7cb3-4f9a-8e0d-04dc0a2ea869 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:22.547451 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:22.551147 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:22.569086 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:22.569719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:22.570649 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:22.571232 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:22.651379 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-de34c0b2-7cb3-4f9a-8e0d-04dc0a2ea869 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:22.661906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-de34c0b2-7cb3-4f9a-8e0d-04dc0a2ea869 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.244002 Jun 27 14:56:22.662664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 33/70] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:22 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:22.775766 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:22.785836 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:22.787410 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:22.788942 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c7b52e7a-342e-4c8f-bbb0-3157b0092831 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.245963 Jun 27 14:56:22.789913 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 38/71] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:22 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:22.875129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a5dea537-c402-4842-af24-ebb9e7c1ab25 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:22.875736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a5dea537-c402-4842-af24-ebb9e7c1ab25 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:22.884257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5dea537-c402-4842-af24-ebb9e7c1ab25 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:22.885112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5dea537-c402-4842-af24-ebb9e7c1ab25 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:22.886186 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5dea537-c402-4842-af24-ebb9e7c1ab25 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:22.886800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5dea537-c402-4842-af24-ebb9e7c1ab25 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:23.035227 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c86b4aea-4886-4add-92c5-291fdabbba8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:23.035901 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c86b4aea-4886-4add-92c5-291fdabbba8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:23.047342 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c86b4aea-4886-4add-92c5-291fdabbba8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:23.048136 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c86b4aea-4886-4add-92c5-291fdabbba8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:23.049155 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c86b4aea-4886-4add-92c5-291fdabbba8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:23.049825 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c86b4aea-4886-4add-92c5-291fdabbba8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:23.096312 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a5dea537-c402-4842-af24-ebb9e7c1ab25 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:23.112792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a5dea537-c402-4842-af24-ebb9e7c1ab25 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.246999 Jun 27 14:56:23.113690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 34/72] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:22 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:23.254216 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c86b4aea-4886-4add-92c5-291fdabbba8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:23.263074 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c86b4aea-4886-4add-92c5-291fdabbba8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.231105 Jun 27 14:56:23.272834 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 39/73] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:23 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:23.679453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-caaad1e1-0387-48db-9b04-3025ea07c617 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:23.690037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-caaad1e1-0387-48db-9b04-3025ea07c617 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:23.690037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-caaad1e1-0387-48db-9b04-3025ea07c617 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:23.690037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-caaad1e1-0387-48db-9b04-3025ea07c617 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:23.690037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-caaad1e1-0387-48db-9b04-3025ea07c617 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:23.690498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-caaad1e1-0387-48db-9b04-3025ea07c617 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:23.811151 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:23.811925 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:23.819821 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:23.820484 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:23.822232 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:23.822232 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:23.866965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-caaad1e1-0387-48db-9b04-3025ea07c617 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:23.878915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-caaad1e1-0387-48db-9b04-3025ea07c617 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.203224 Jun 27 14:56:23.879794 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 35/74] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:23 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:24.004120 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:24.013252 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:24.014883 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:24.016014 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-1e49a8e8-a406-4856-8450-032af91ad8a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.209675 Jun 27 14:56:24.016573 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 40/75] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:23 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:24.130194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1b89e435-b0a2-43e3-ad5c-c5776e7cf043 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:24.131416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1b89e435-b0a2-43e3-ad5c-c5776e7cf043 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:24.138793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1b89e435-b0a2-43e3-ad5c-c5776e7cf043 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:24.139456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1b89e435-b0a2-43e3-ad5c-c5776e7cf043 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:24.140341 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1b89e435-b0a2-43e3-ad5c-c5776e7cf043 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:24.140979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1b89e435-b0a2-43e3-ad5c-c5776e7cf043 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:24.280301 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-3ff1c816-ad9b-4536-bb44-97837b106096 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:24.280857 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-3ff1c816-ad9b-4536-bb44-97837b106096 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:24.285579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1b89e435-b0a2-43e3-ad5c-c5776e7cf043 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:24.286880 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3ff1c816-ad9b-4536-bb44-97837b106096 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:24.287324 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3ff1c816-ad9b-4536-bb44-97837b106096 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:24.288086 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3ff1c816-ad9b-4536-bb44-97837b106096 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:24.288513 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3ff1c816-ad9b-4536-bb44-97837b106096 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:24.294494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1b89e435-b0a2-43e3-ad5c-c5776e7cf043 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.168227 Jun 27 14:56:24.295830 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 36/76] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:24 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:24.464591 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-3ff1c816-ad9b-4536-bb44-97837b106096 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:24.473035 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-3ff1c816-ad9b-4536-bb44-97837b106096 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.197321 Jun 27 14:56:24.473614 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 41/77] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:24 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:24.897420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6dba015f-585e-4278-aa9c-cb6bf7393693 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:24.898144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6dba015f-585e-4278-aa9c-cb6bf7393693 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:24.905028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6dba015f-585e-4278-aa9c-cb6bf7393693 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:24.905541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6dba015f-585e-4278-aa9c-cb6bf7393693 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:24.906359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6dba015f-585e-4278-aa9c-cb6bf7393693 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:24.907998 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6dba015f-585e-4278-aa9c-cb6bf7393693 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:25.034411 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:25.037012 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:25.044933 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:25.045503 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:25.046403 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:25.046900 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:25.074542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6dba015f-585e-4278-aa9c-cb6bf7393693 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:25.085324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6dba015f-585e-4278-aa9c-cb6bf7393693 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.192192 Jun 27 14:56:25.096863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 37/78] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:24 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:25.235152 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:25.243477 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:25.244997 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:25.246111 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-38965869-b8f6-41e5-8c3c-af237722428b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.215649 Jun 27 14:56:25.247385 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 42/79] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:25 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:25.312837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0c9f1137-491b-469c-a6dc-1598b9f0341b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:25.313438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0c9f1137-491b-469c-a6dc-1598b9f0341b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:25.320612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c9f1137-491b-469c-a6dc-1598b9f0341b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:25.321225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c9f1137-491b-469c-a6dc-1598b9f0341b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:25.322067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c9f1137-491b-469c-a6dc-1598b9f0341b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:25.322691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c9f1137-491b-469c-a6dc-1598b9f0341b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:25.346978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:25.490488 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-38bcf63e-c420-46f0-ae1c-d2686c72a50a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:25.493715 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-38bcf63e-c420-46f0-ae1c-d2686c72a50a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:25.495754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0c9f1137-491b-469c-a6dc-1598b9f0341b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:25.497511 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-38bcf63e-c420-46f0-ae1c-d2686c72a50a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:25.497963 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-38bcf63e-c420-46f0-ae1c-d2686c72a50a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:25.498787 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-38bcf63e-c420-46f0-ae1c-d2686c72a50a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:25.499223 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-38bcf63e-c420-46f0-ae1c-d2686c72a50a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:25.503608 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0c9f1137-491b-469c-a6dc-1598b9f0341b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.196106 Jun 27 14:56:25.504175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 38/80] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:25 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:25.634120 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-38bcf63e-c420-46f0-ae1c-d2686c72a50a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:25.641999 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-38bcf63e-c420-46f0-ae1c-d2686c72a50a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.155472 Jun 27 14:56:25.642558 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 43/81] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:25 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:26.104418 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-062d1d03-00fe-48c1-997f-5932bb74bda2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:26.105099 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-062d1d03-00fe-48c1-997f-5932bb74bda2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:26.129090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-062d1d03-00fe-48c1-997f-5932bb74bda2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:26.129535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-062d1d03-00fe-48c1-997f-5932bb74bda2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:26.130537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-062d1d03-00fe-48c1-997f-5932bb74bda2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:26.131440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-062d1d03-00fe-48c1-997f-5932bb74bda2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:26.264903 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:26.269163 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:26.274219 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:26.274668 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:26.275450 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:26.275884 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:26.324286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-062d1d03-00fe-48c1-997f-5932bb74bda2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:26.333932 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-062d1d03-00fe-48c1-997f-5932bb74bda2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.234087 Jun 27 14:56:26.344969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 39/82] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:26 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:26.510919 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:26.521946 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:26.523781 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:26.525261 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4e058195-4ac1-4bd8-9fac-53dfd4a7120e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.264954 Jun 27 14:56:26.526624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-54d2eb2d-674e-42b5-a1ed-3a59d5e23585 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:26.529217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-54d2eb2d-674e-42b5-a1ed-3a59d5e23585 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:26.537206 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 44/83] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:26 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:26.542227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54d2eb2d-674e-42b5-a1ed-3a59d5e23585 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:26.542227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54d2eb2d-674e-42b5-a1ed-3a59d5e23585 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:26.542958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54d2eb2d-674e-42b5-a1ed-3a59d5e23585 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:26.544293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54d2eb2d-674e-42b5-a1ed-3a59d5e23585 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:26.662825 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-33e97db4-757d-4972-bee6-7e3b7dea7450 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:26.664405 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-33e97db4-757d-4972-bee6-7e3b7dea7450 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:26.676480 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-33e97db4-757d-4972-bee6-7e3b7dea7450 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:26.678337 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-33e97db4-757d-4972-bee6-7e3b7dea7450 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:26.678337 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-33e97db4-757d-4972-bee6-7e3b7dea7450 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:26.678337 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-33e97db4-757d-4972-bee6-7e3b7dea7450 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:26.713407 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:26.754993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-54d2eb2d-674e-42b5-a1ed-3a59d5e23585 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:26.763032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-54d2eb2d-674e-42b5-a1ed-3a59d5e23585 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.242458 Jun 27 14:56:26.763613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 40/84] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:26 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:26.831487 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-33e97db4-757d-4972-bee6-7e3b7dea7450 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:26.839067 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-33e97db4-757d-4972-bee6-7e3b7dea7450 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.181530 Jun 27 14:56:26.839699 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 45/85] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:26 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:27.352757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cf50bd9c-c4ca-459f-96ba-54c0ce6511b1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:27.353362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cf50bd9c-c4ca-459f-96ba-54c0ce6511b1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:27.360463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf50bd9c-c4ca-459f-96ba-54c0ce6511b1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:27.362684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf50bd9c-c4ca-459f-96ba-54c0ce6511b1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:27.362684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf50bd9c-c4ca-459f-96ba-54c0ce6511b1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:27.362684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf50bd9c-c4ca-459f-96ba-54c0ce6511b1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:27.495200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cf50bd9c-c4ca-459f-96ba-54c0ce6511b1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:27.503192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cf50bd9c-c4ca-459f-96ba-54c0ce6511b1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.154453 Jun 27 14:56:27.503845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 41/86] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:27 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:27.550842 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:27.550842 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:27.552451 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:27.552451 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:27.553471 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:27.553912 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:27.738106 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:27.746179 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:27.747663 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:27.748809 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c4463c52-e947-43c8-9bae-56cc1e84119f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.208356 Jun 27 14:56:27.754200 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 46/87] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:27 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:27.779431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0279f9a6-4f07-4898-8811-ec597193bc98 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:27.780760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0279f9a6-4f07-4898-8811-ec597193bc98 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:27.787019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0279f9a6-4f07-4898-8811-ec597193bc98 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:27.787472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0279f9a6-4f07-4898-8811-ec597193bc98 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:27.788276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0279f9a6-4f07-4898-8811-ec597193bc98 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:27.788743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0279f9a6-4f07-4898-8811-ec597193bc98 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:27.857922 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-fe7494b0-2762-49fc-80ef-84535c1f8f12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:27.858733 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-fe7494b0-2762-49fc-80ef-84535c1f8f12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:27.865192 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fe7494b0-2762-49fc-80ef-84535c1f8f12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:27.865464 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fe7494b0-2762-49fc-80ef-84535c1f8f12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:27.866495 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fe7494b0-2762-49fc-80ef-84535c1f8f12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:27.866951 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fe7494b0-2762-49fc-80ef-84535c1f8f12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:27.925552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0279f9a6-4f07-4898-8811-ec597193bc98 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:27.933251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0279f9a6-4f07-4898-8811-ec597193bc98 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.157468 Jun 27 14:56:27.937365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 42/88] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:27 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:28.025678 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fe7494b0-2762-49fc-80ef-84535c1f8f12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:28.034060 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-fe7494b0-2762-49fc-80ef-84535c1f8f12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.179898 Jun 27 14:56:28.034566 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 47/89] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:27 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:28.520958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-00652d02-72bf-477f-8b8b-d0ee9a18436e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:28.521677 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-00652d02-72bf-477f-8b8b-d0ee9a18436e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:28.527788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00652d02-72bf-477f-8b8b-d0ee9a18436e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:28.528448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00652d02-72bf-477f-8b8b-d0ee9a18436e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:28.529665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00652d02-72bf-477f-8b8b-d0ee9a18436e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:28.530454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00652d02-72bf-477f-8b8b-d0ee9a18436e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:28.669640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-00652d02-72bf-477f-8b8b-d0ee9a18436e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:28.688843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-00652d02-72bf-477f-8b8b-d0ee9a18436e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.172552 Jun 27 14:56:28.694040 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 43/90] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:28 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:28.775590 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:28.776982 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:28.784573 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:28.785114 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:28.785996 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:28.786539 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:28.937091 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:28.947730 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:28.949582 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:28.950954 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-62223789-30b6-4f2d-9b2c-1eb7bbac0022 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.180122 Jun 27 14:56:28.951482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9f8520ad-4a85-4ddc-b26e-c93c1362d654 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:28.952377 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 48/91] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:28 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:28.953811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9f8520ad-4a85-4ddc-b26e-c93c1362d654 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:28.957083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:28.961178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f8520ad-4a85-4ddc-b26e-c93c1362d654 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:28.961774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f8520ad-4a85-4ddc-b26e-c93c1362d654 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:28.962554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f8520ad-4a85-4ddc-b26e-c93c1362d654 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:28.962991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f8520ad-4a85-4ddc-b26e-c93c1362d654 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:29.051877 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-04e77c93-d8b1-4736-8998-7a2c0e74c9cb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:29.052762 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-04e77c93-d8b1-4736-8998-7a2c0e74c9cb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:29.060828 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-04e77c93-d8b1-4736-8998-7a2c0e74c9cb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:29.061322 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-04e77c93-d8b1-4736-8998-7a2c0e74c9cb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:29.062485 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-04e77c93-d8b1-4736-8998-7a2c0e74c9cb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:29.063115 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-04e77c93-d8b1-4736-8998-7a2c0e74c9cb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:29.116810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9f8520ad-4a85-4ddc-b26e-c93c1362d654 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:29.126249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9f8520ad-4a85-4ddc-b26e-c93c1362d654 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.179479 Jun 27 14:56:29.135370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 44/92] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:28 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:29.219494 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-04e77c93-d8b1-4736-8998-7a2c0e74c9cb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:29.226845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-04e77c93-d8b1-4736-8998-7a2c0e74c9cb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.179037 Jun 27 14:56:29.227416 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 49/93] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:29 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:29.706755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-29560c96-407c-4b21-9311-a840971787a3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:29.708403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-29560c96-407c-4b21-9311-a840971787a3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:29.713534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29560c96-407c-4b21-9311-a840971787a3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:29.714043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29560c96-407c-4b21-9311-a840971787a3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:29.714816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29560c96-407c-4b21-9311-a840971787a3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:29.715255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29560c96-407c-4b21-9311-a840971787a3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:29.900550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-29560c96-407c-4b21-9311-a840971787a3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:29.908920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-29560c96-407c-4b21-9311-a840971787a3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.205979 Jun 27 14:56:29.909600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 45/94] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:29 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:29.969558 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:29.970223 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:29.976122 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:29.976570 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:29.977386 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:29.977820 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:30.126897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:30.135250 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:30.136861 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:30.137968 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e1ef1567-7715-4152-bba8-6a3f87e8d784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.172729 Jun 27 14:56:30.143376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1578829d-7f77-4baf-990b-d3348b13ac67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:30.143989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1578829d-7f77-4baf-990b-d3348b13ac67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:30.146311 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 50/95] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:29 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:30.150084 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1578829d-7f77-4baf-990b-d3348b13ac67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:30.150785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1578829d-7f77-4baf-990b-d3348b13ac67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:30.151557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1578829d-7f77-4baf-990b-d3348b13ac67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:30.151994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1578829d-7f77-4baf-990b-d3348b13ac67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:30.244252 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-88dab062-16d0-4044-a3f2-3ab17a859320 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:30.244965 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-88dab062-16d0-4044-a3f2-3ab17a859320 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:30.248125 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=2 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:30.252980 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-88dab062-16d0-4044-a3f2-3ab17a859320 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:30.253432 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-88dab062-16d0-4044-a3f2-3ab17a859320 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:30.259236 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-88dab062-16d0-4044-a3f2-3ab17a859320 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:30.259236 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-88dab062-16d0-4044-a3f2-3ab17a859320 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:30.284013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1578829d-7f77-4baf-990b-d3348b13ac67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:30.292062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1578829d-7f77-4baf-990b-d3348b13ac67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.152747 Jun 27 14:56:30.292663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 46/96] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:30 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:30.395149 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-88dab062-16d0-4044-a3f2-3ab17a859320 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:30.402847 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-88dab062-16d0-4044-a3f2-3ab17a859320 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.162705 Jun 27 14:56:30.404339 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 51/97] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:30 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:30.926975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b504d452-25c2-4da4-b545-6fc1d236a63c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:30.927748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b504d452-25c2-4da4-b545-6fc1d236a63c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:30.933897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b504d452-25c2-4da4-b545-6fc1d236a63c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:30.934352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b504d452-25c2-4da4-b545-6fc1d236a63c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:30.935116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b504d452-25c2-4da4-b545-6fc1d236a63c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:30.935550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b504d452-25c2-4da4-b545-6fc1d236a63c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:31.072334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b504d452-25c2-4da4-b545-6fc1d236a63c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:31.080631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b504d452-25c2-4da4-b545-6fc1d236a63c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.157506 Jun 27 14:56:31.081214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 47/98] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:30 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:31.163318 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:31.164005 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:31.170017 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:31.171149 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:31.172389 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:31.172389 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:31.297878 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:31.306073 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:31.307579 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:31.308748 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-231b29c3-5624-434e-a5c4-61f5cc3d9bf5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.149307 Jun 27 14:56:31.309297 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 52/99] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:31 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:31.309563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bce42a80-5e3d-46d3-b6a0-2ded665ff3bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:31.310247 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bce42a80-5e3d-46d3-b6a0-2ded665ff3bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:31.316991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bce42a80-5e3d-46d3-b6a0-2ded665ff3bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:31.317434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bce42a80-5e3d-46d3-b6a0-2ded665ff3bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:31.318215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bce42a80-5e3d-46d3-b6a0-2ded665ff3bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:31.318648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bce42a80-5e3d-46d3-b6a0-2ded665ff3bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:31.420587 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d822c114-a57d-4b1f-b759-ccca752d3cdf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:31.421328 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d822c114-a57d-4b1f-b759-ccca752d3cdf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:31.427461 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d822c114-a57d-4b1f-b759-ccca752d3cdf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:31.427907 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d822c114-a57d-4b1f-b759-ccca752d3cdf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:31.428699 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d822c114-a57d-4b1f-b759-ccca752d3cdf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:31.429138 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d822c114-a57d-4b1f-b759-ccca752d3cdf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:31.446749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bce42a80-5e3d-46d3-b6a0-2ded665ff3bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:31.455725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bce42a80-5e3d-46d3-b6a0-2ded665ff3bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.150169 Jun 27 14:56:31.456301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 48/100] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:31 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:31.564738 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d822c114-a57d-4b1f-b759-ccca752d3cdf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:31.572160 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d822c114-a57d-4b1f-b759-ccca752d3cdf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.155354 Jun 27 14:56:31.573215 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 53/101] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:31 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:32.098528 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b91c7635-a9c4-493b-b81a-be6afe207971 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:32.099599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b91c7635-a9c4-493b-b81a-be6afe207971 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:32.107160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b91c7635-a9c4-493b-b81a-be6afe207971 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:32.108106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b91c7635-a9c4-493b-b81a-be6afe207971 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:32.109333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b91c7635-a9c4-493b-b81a-be6afe207971 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:32.109431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b91c7635-a9c4-493b-b81a-be6afe207971 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:32.251717 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b91c7635-a9c4-493b-b81a-be6afe207971 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:32.262445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b91c7635-a9c4-493b-b81a-be6afe207971 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.167979 Jun 27 14:56:32.264862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 49/102] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:32 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:32.334289 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:32.334289 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:32.342316 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:32.343359 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:32.344813 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:32.345452 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:32.473509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-97dea1e9-751d-4f76-a2d6-9f6c0ccc4048 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:32.474123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-97dea1e9-751d-4f76-a2d6-9f6c0ccc4048 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:32.480518 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97dea1e9-751d-4f76-a2d6-9f6c0ccc4048 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:32.481065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97dea1e9-751d-4f76-a2d6-9f6c0ccc4048 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:32.481842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97dea1e9-751d-4f76-a2d6-9f6c0ccc4048 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:32.482278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97dea1e9-751d-4f76-a2d6-9f6c0ccc4048 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:32.819704 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:32.832554 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:32.839149 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:32.841007 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-ad73411f-a6ae-4d0c-a918-1fc150056ed7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.516422 Jun 27 14:56:32.842234 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 54/103] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:32 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:32.848226 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-051a5fee-f42f-46e2-8f1a-6b19d0b1ac00 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:32.848879 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-051a5fee-f42f-46e2-8f1a-6b19d0b1ac00 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:32.858851 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-051a5fee-f42f-46e2-8f1a-6b19d0b1ac00 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:32.859313 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-051a5fee-f42f-46e2-8f1a-6b19d0b1ac00 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:32.860301 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-051a5fee-f42f-46e2-8f1a-6b19d0b1ac00 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:32.860767 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-051a5fee-f42f-46e2-8f1a-6b19d0b1ac00 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:32.996105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-97dea1e9-751d-4f76-a2d6-9f6c0ccc4048 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:33.041007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-97dea1e9-751d-4f76-a2d6-9f6c0ccc4048 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.567332 Jun 27 14:56:33.042641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 50/104] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:32 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:33.070368 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-af025db4-a2f3-4f41-a011-df171f7f319c req-13ca1cbe-8110-47e0-9973-1bad08dcef73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbec56f5-672a-4067-8656-c5d152daef90", "tag": "dc6a0f8d-f77c-413a-9022-cbcffb6de783"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:33.096286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-af025db4-a2f3-4f41-a011-df171f7f319c req-13ca1cbe-8110-47e0-9973-1bad08dcef73 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:33.097307 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-af025db4-a2f3-4f41-a011-df171f7f319c req-13ca1cbe-8110-47e0-9973-1bad08dcef73 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:33.126596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-af025db4-a2f3-4f41-a011-df171f7f319c req-13ca1cbe-8110-47e0-9973-1bad08dcef73 service nova] Creating event network-changed:dc6a0f8d-f77c-413a-9022-cbcffb6de783 for instance bbec56f5-672a-4067-8656-c5d152daef90 on hv-cinder-79760 Jun 27 14:56:33.135526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-af025db4-a2f3-4f41-a011-df171f7f319c req-13ca1cbe-8110-47e0-9973-1bad08dcef73 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091598 Jun 27 14:56:33.137335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 51/105] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:56:33.282841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bf3a61b1-4ef1-454a-a5dc-94912f81aa38 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:33.283685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bf3a61b1-4ef1-454a-a5dc-94912f81aa38 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:33.301335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf3a61b1-4ef1-454a-a5dc-94912f81aa38 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:33.303451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf3a61b1-4ef1-454a-a5dc-94912f81aa38 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:33.306149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf3a61b1-4ef1-454a-a5dc-94912f81aa38 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:33.309344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf3a61b1-4ef1-454a-a5dc-94912f81aa38 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:33.492479 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-051a5fee-f42f-46e2-8f1a-6b19d0b1ac00 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:33.500213 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-051a5fee-f42f-46e2-8f1a-6b19d0b1ac00 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.656378 Jun 27 14:56:33.500830 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 55/106] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:32 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:33.699636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bf3a61b1-4ef1-454a-a5dc-94912f81aa38 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:33.719134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bf3a61b1-4ef1-454a-a5dc-94912f81aa38 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.442375 Jun 27 14:56:33.720191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 52/107] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:33 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:33.865405 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:33.866007 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:33.873765 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:33.874654 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:33.875422 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:33.875866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:34.058739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4e03e5a2-3696-4892-923a-8f7bfd2bdc57 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:34.063048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4e03e5a2-3696-4892-923a-8f7bfd2bdc57 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:34.082700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e03e5a2-3696-4892-923a-8f7bfd2bdc57 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:34.112266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e03e5a2-3696-4892-923a-8f7bfd2bdc57 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:34.113418 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e03e5a2-3696-4892-923a-8f7bfd2bdc57 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:34.113955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e03e5a2-3696-4892-923a-8f7bfd2bdc57 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:34.268573 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:34.278324 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:34.280522 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:34.281897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-813a6204-7b5a-4b9e-bb7a-48814b33f659 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.420689 Jun 27 14:56:34.285065 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 56/108] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:33 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:34.289084 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-7501ed7a-c3f8-4880-ba9e-227ada2ab2ab req-f5754803-c6a6-4cda-82a7-9ca1bf6e937a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67eac8a-bfba-489d-8d6d-11956e1b4e90", "tag": "2f2fac3d-9b57-4c4a-a63d-b53b86aca080"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:34.298798 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-7501ed7a-c3f8-4880-ba9e-227ada2ab2ab req-f5754803-c6a6-4cda-82a7-9ca1bf6e937a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:34.299397 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-7501ed7a-c3f8-4880-ba9e-227ada2ab2ab req-f5754803-c6a6-4cda-82a7-9ca1bf6e937a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:34.322786 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-7501ed7a-c3f8-4880-ba9e-227ada2ab2ab req-f5754803-c6a6-4cda-82a7-9ca1bf6e937a service nova] Creating event network-changed:2f2fac3d-9b57-4c4a-a63d-b53b86aca080 for instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 on hv-cinder-79760 Jun 27 14:56:34.334537 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-7501ed7a-c3f8-4880-ba9e-227ada2ab2ab req-f5754803-c6a6-4cda-82a7-9ca1bf6e937a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050378 Jun 27 14:56:34.335771 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 57/109] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:56:34.384869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4e03e5a2-3696-4892-923a-8f7bfd2bdc57 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:34.393583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4e03e5a2-3696-4892-923a-8f7bfd2bdc57 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.338746 Jun 27 14:56:34.394142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 53/110] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:34 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:34.518751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d86c2116-eefd-4c66-9f8f-3afc60c23da4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:34.519445 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d86c2116-eefd-4c66-9f8f-3afc60c23da4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:34.525630 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d86c2116-eefd-4c66-9f8f-3afc60c23da4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:34.526082 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d86c2116-eefd-4c66-9f8f-3afc60c23da4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:34.526845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d86c2116-eefd-4c66-9f8f-3afc60c23da4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:34.527281 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d86c2116-eefd-4c66-9f8f-3afc60c23da4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:34.656396 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d86c2116-eefd-4c66-9f8f-3afc60c23da4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:34.663953 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d86c2116-eefd-4c66-9f8f-3afc60c23da4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.150341 Jun 27 14:56:34.664613 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 58/111] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:34 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:34.735292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d8f1100b-9829-44a0-ad72-40cbee103ce3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:34.735813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d8f1100b-9829-44a0-ad72-40cbee103ce3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:34.741675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d8f1100b-9829-44a0-ad72-40cbee103ce3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:34.742172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d8f1100b-9829-44a0-ad72-40cbee103ce3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:34.742915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d8f1100b-9829-44a0-ad72-40cbee103ce3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:34.743346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d8f1100b-9829-44a0-ad72-40cbee103ce3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:34.871852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d8f1100b-9829-44a0-ad72-40cbee103ce3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:34.880936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d8f1100b-9829-44a0-ad72-40cbee103ce3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.149470 Jun 27 14:56:34.881748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 54/112] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:34 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:35.300604 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:35.301166 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:35.307283 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:35.307761 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:35.308637 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:35.309089 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:35.410520 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a6cf380-8b74-46a5-aad5-310529e116b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:35.411143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5a6cf380-8b74-46a5-aad5-310529e116b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:35.417207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a6cf380-8b74-46a5-aad5-310529e116b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:35.417650 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a6cf380-8b74-46a5-aad5-310529e116b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:35.418403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a6cf380-8b74-46a5-aad5-310529e116b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:35.418828 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a6cf380-8b74-46a5-aad5-310529e116b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:35.456914 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:35.464836 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:35.466322 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:35.467695 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-00247326-b0fb-4391-a292-1714c0354624 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.170779 Jun 27 14:56:35.468172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 59/113] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:35 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:35.558777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5a6cf380-8b74-46a5-aad5-310529e116b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:35.563063 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:35.567563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5a6cf380-8b74-46a5-aad5-310529e116b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.161083 Jun 27 14:56:35.568115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 55/114] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:35 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:35.679917 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9ba5749f-a001-4567-8275-c4360584f0cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:35.680523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-9ba5749f-a001-4567-8275-c4360584f0cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:35.687237 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9ba5749f-a001-4567-8275-c4360584f0cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:35.687667 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9ba5749f-a001-4567-8275-c4360584f0cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:35.688431 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9ba5749f-a001-4567-8275-c4360584f0cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:35.688893 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9ba5749f-a001-4567-8275-c4360584f0cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:35.819814 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9ba5749f-a001-4567-8275-c4360584f0cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:35.827679 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-9ba5749f-a001-4567-8275-c4360584f0cd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.151509 Jun 27 14:56:35.832014 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 60/115] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:35 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:35.898246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2ee71dbf-a58f-4cc5-bc7a-de58a5b200d3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:35.898842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2ee71dbf-a58f-4cc5-bc7a-de58a5b200d3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:35.905858 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ee71dbf-a58f-4cc5-bc7a-de58a5b200d3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:35.906301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ee71dbf-a58f-4cc5-bc7a-de58a5b200d3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:35.907047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ee71dbf-a58f-4cc5-bc7a-de58a5b200d3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:35.907471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ee71dbf-a58f-4cc5-bc7a-de58a5b200d3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:36.049730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2ee71dbf-a58f-4cc5-bc7a-de58a5b200d3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:36.057101 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2ee71dbf-a58f-4cc5-bc7a-de58a5b200d3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.162786 Jun 27 14:56:36.058449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 56/116] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:35 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:36.485785 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:36.486385 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:36.492438 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:36.492929 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:36.493686 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:36.494124 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:36.583529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-490ff2b0-5aab-4c33-b782-fed164f266c3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:36.584133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-490ff2b0-5aab-4c33-b782-fed164f266c3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:36.591049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-490ff2b0-5aab-4c33-b782-fed164f266c3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:36.591672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-490ff2b0-5aab-4c33-b782-fed164f266c3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:36.592609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-490ff2b0-5aab-4c33-b782-fed164f266c3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:36.593216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-490ff2b0-5aab-4c33-b782-fed164f266c3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:36.635314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:36.647016 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:36.648528 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:36.649658 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d7d2446d-0c9a-4f79-900e-da4f2fe610f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.168418 Jun 27 14:56:36.650417 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 61/117] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:36 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:36.743925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-490ff2b0-5aab-4c33-b782-fed164f266c3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:36.752270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-490ff2b0-5aab-4c33-b782-fed164f266c3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.172521 Jun 27 14:56:36.752886 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 57/118] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:36 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:36.844826 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-bcce20b7-a112-4783-a8f7-eec911f85172 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:36.845650 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-bcce20b7-a112-4783-a8f7-eec911f85172 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:36.852220 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bcce20b7-a112-4783-a8f7-eec911f85172 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:36.852711 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bcce20b7-a112-4783-a8f7-eec911f85172 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:36.853473 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bcce20b7-a112-4783-a8f7-eec911f85172 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:36.853910 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bcce20b7-a112-4783-a8f7-eec911f85172 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:36.986649 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-bcce20b7-a112-4783-a8f7-eec911f85172 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:36.991681 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:36.999481 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-bcce20b7-a112-4783-a8f7-eec911f85172 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.158289 Jun 27 14:56:37.000221 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 62/119] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:36 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:37.074619 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2f143da5-8441-4c66-bde7-179095baaf95 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:37.075311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2f143da5-8441-4c66-bde7-179095baaf95 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:37.081664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f143da5-8441-4c66-bde7-179095baaf95 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:37.082109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f143da5-8441-4c66-bde7-179095baaf95 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:37.082865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f143da5-8441-4c66-bde7-179095baaf95 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:37.083300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f143da5-8441-4c66-bde7-179095baaf95 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:37.242734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2f143da5-8441-4c66-bde7-179095baaf95 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:37.250501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2f143da5-8441-4c66-bde7-179095baaf95 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.179892 Jun 27 14:56:37.251245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 58/120] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:37 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:37.667930 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:37.668458 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:37.675554 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:37.676019 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:37.677163 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:37.677600 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:37.769411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d97180fa-aa3a-49f1-8c47-2608a0292314 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:37.770019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d97180fa-aa3a-49f1-8c47-2608a0292314 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:37.776108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d97180fa-aa3a-49f1-8c47-2608a0292314 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:37.776555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d97180fa-aa3a-49f1-8c47-2608a0292314 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:37.777347 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d97180fa-aa3a-49f1-8c47-2608a0292314 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:37.777788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d97180fa-aa3a-49f1-8c47-2608a0292314 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:37.816997 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:37.825993 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:37.828062 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:37.829393 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-9b6bb284-f6e2-467b-9230-bdb98f3dfada tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.165939 Jun 27 14:56:37.830044 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 63/121] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:37 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:37.927968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d97180fa-aa3a-49f1-8c47-2608a0292314 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:37.935636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d97180fa-aa3a-49f1-8c47-2608a0292314 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.170015 Jun 27 14:56:37.936402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 59/122] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:37 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:38.016569 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d10fd027-3c90-459a-acab-a31cdf53c207 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:38.018049 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d10fd027-3c90-459a-acab-a31cdf53c207 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:38.025369 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d10fd027-3c90-459a-acab-a31cdf53c207 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:38.026066 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d10fd027-3c90-459a-acab-a31cdf53c207 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:38.031036 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d10fd027-3c90-459a-acab-a31cdf53c207 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:38.031036 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d10fd027-3c90-459a-acab-a31cdf53c207 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:38.180751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d10fd027-3c90-459a-acab-a31cdf53c207 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:38.189112 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d10fd027-3c90-459a-acab-a31cdf53c207 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.176750 Jun 27 14:56:38.189687 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 64/123] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:38 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:38.267312 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a04de827-bb58-4f7a-a27d-8b2a6f517938 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:38.268017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a04de827-bb58-4f7a-a27d-8b2a6f517938 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:38.274343 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a04de827-bb58-4f7a-a27d-8b2a6f517938 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:38.274718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a04de827-bb58-4f7a-a27d-8b2a6f517938 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:38.275471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a04de827-bb58-4f7a-a27d-8b2a6f517938 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:38.275901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a04de827-bb58-4f7a-a27d-8b2a6f517938 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:38.407360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a04de827-bb58-4f7a-a27d-8b2a6f517938 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:38.414935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a04de827-bb58-4f7a-a27d-8b2a6f517938 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.151620 Jun 27 14:56:38.415519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 60/124] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:38 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:38.847883 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:38.848906 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:38.855268 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:38.855524 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:38.856321 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:38.856971 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:38.953850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2e685a1d-33f4-4591-95af-de6c92ff23db tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:38.954675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2e685a1d-33f4-4591-95af-de6c92ff23db tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:38.963567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e685a1d-33f4-4591-95af-de6c92ff23db tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:38.963567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e685a1d-33f4-4591-95af-de6c92ff23db tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:38.963567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e685a1d-33f4-4591-95af-de6c92ff23db tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:38.963567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e685a1d-33f4-4591-95af-de6c92ff23db tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:39.026554 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:39.038764 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:39.040609 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:39.043644 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-a156fa8f-e2c4-419b-a005-462fe388d136 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.198551 Jun 27 14:56:39.043644 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 65/125] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:38 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:39.133788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2e685a1d-33f4-4591-95af-de6c92ff23db tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:39.141982 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2e685a1d-33f4-4591-95af-de6c92ff23db tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.192380 Jun 27 14:56:39.142568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 61/126] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:38 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:39.206673 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-93b8d4d3-957e-49d9-810d-f4fcea3c7fd2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:39.207411 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-93b8d4d3-957e-49d9-810d-f4fcea3c7fd2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:39.213978 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-93b8d4d3-957e-49d9-810d-f4fcea3c7fd2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:39.214410 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-93b8d4d3-957e-49d9-810d-f4fcea3c7fd2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:39.215169 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-93b8d4d3-957e-49d9-810d-f4fcea3c7fd2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:39.215606 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-93b8d4d3-957e-49d9-810d-f4fcea3c7fd2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:39.346048 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-93b8d4d3-957e-49d9-810d-f4fcea3c7fd2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:39.353495 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-93b8d4d3-957e-49d9-810d-f4fcea3c7fd2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.150845 Jun 27 14:56:39.354058 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 66/127] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:39 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:39.432498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-87eaeca6-35a9-4404-a8f0-a4c1552c8dae tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:39.433130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-87eaeca6-35a9-4404-a8f0-a4c1552c8dae tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:39.439561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87eaeca6-35a9-4404-a8f0-a4c1552c8dae tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:39.440026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87eaeca6-35a9-4404-a8f0-a4c1552c8dae tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:39.441065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87eaeca6-35a9-4404-a8f0-a4c1552c8dae tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:39.441498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87eaeca6-35a9-4404-a8f0-a4c1552c8dae tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:39.569035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-87eaeca6-35a9-4404-a8f0-a4c1552c8dae tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:39.576969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-87eaeca6-35a9-4404-a8f0-a4c1552c8dae tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.147722 Jun 27 14:56:39.577543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 62/128] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:39 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:40.060254 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:40.061539 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:40.068059 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:40.068516 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:40.069311 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:40.069745 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:40.159980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f280563b-288f-4e07-b617-01aa1b83c7c2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:40.160585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f280563b-288f-4e07-b617-01aa1b83c7c2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:40.166620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f280563b-288f-4e07-b617-01aa1b83c7c2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:40.167055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f280563b-288f-4e07-b617-01aa1b83c7c2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:40.167802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f280563b-288f-4e07-b617-01aa1b83c7c2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:40.168226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f280563b-288f-4e07-b617-01aa1b83c7c2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:40.207234 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:40.220016 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:40.221538 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:40.222642 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-3ab8eb08-9ef9-43a7-a963-210d74001c92 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.166281 Jun 27 14:56:40.235100 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 67/129] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:40 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:40.307528 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f280563b-288f-4e07-b617-01aa1b83c7c2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:40.315265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f280563b-288f-4e07-b617-01aa1b83c7c2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.159469 Jun 27 14:56:40.316090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 63/130] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:40 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:40.370743 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-303229ad-8c38-4bc9-aa72-7e6437f4d6a1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:40.371330 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-303229ad-8c38-4bc9-aa72-7e6437f4d6a1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:40.378560 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-303229ad-8c38-4bc9-aa72-7e6437f4d6a1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:40.379008 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-303229ad-8c38-4bc9-aa72-7e6437f4d6a1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:40.379832 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-303229ad-8c38-4bc9-aa72-7e6437f4d6a1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:40.380262 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-303229ad-8c38-4bc9-aa72-7e6437f4d6a1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:40.510193 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-303229ad-8c38-4bc9-aa72-7e6437f4d6a1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:40.518249 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-303229ad-8c38-4bc9-aa72-7e6437f4d6a1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.151526 Jun 27 14:56:40.518809 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 68/131] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:40 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:40.593554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bf4cc982-2996-4019-bfe4-d6f800e6c64c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:40.594113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bf4cc982-2996-4019-bfe4-d6f800e6c64c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:40.600019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf4cc982-2996-4019-bfe4-d6f800e6c64c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:40.604202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf4cc982-2996-4019-bfe4-d6f800e6c64c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:40.604202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf4cc982-2996-4019-bfe4-d6f800e6c64c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:40.604202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf4cc982-2996-4019-bfe4-d6f800e6c64c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:40.726012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bf4cc982-2996-4019-bfe4-d6f800e6c64c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:40.733467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bf4cc982-2996-4019-bfe4-d6f800e6c64c tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.144519 Jun 27 14:56:40.739564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 64/132] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:40 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:41.241222 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:41.242934 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:41.251082 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:41.251766 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:41.253027 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:41.254018 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:41.331600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fe6ddc73-a822-4f53-b7a1-f465ea7b6dd0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:41.332203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fe6ddc73-a822-4f53-b7a1-f465ea7b6dd0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:41.338707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe6ddc73-a822-4f53-b7a1-f465ea7b6dd0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:41.339402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe6ddc73-a822-4f53-b7a1-f465ea7b6dd0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:41.340376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe6ddc73-a822-4f53-b7a1-f465ea7b6dd0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:41.341017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe6ddc73-a822-4f53-b7a1-f465ea7b6dd0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:41.439538 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:41.448657 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:41.450298 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:41.451467 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e1caf656-23c0-43d7-96e8-0c4089885e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.214293 Jun 27 14:56:41.462039 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 69/133] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:41 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:41.490286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fe6ddc73-a822-4f53-b7a1-f465ea7b6dd0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:41.497702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fe6ddc73-a822-4f53-b7a1-f465ea7b6dd0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.169889 Jun 27 14:56:41.499135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 65/134] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:41 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:41.534162 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-817b6247-ca19-4cbe-985c-fac0bd9853ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:41.534845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-817b6247-ca19-4cbe-985c-fac0bd9853ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:41.540760 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-817b6247-ca19-4cbe-985c-fac0bd9853ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:41.541323 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-817b6247-ca19-4cbe-985c-fac0bd9853ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:41.542066 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-817b6247-ca19-4cbe-985c-fac0bd9853ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:41.542495 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-817b6247-ca19-4cbe-985c-fac0bd9853ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:41.678172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-817b6247-ca19-4cbe-985c-fac0bd9853ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:41.685768 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-817b6247-ca19-4cbe-985c-fac0bd9853ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.155508 Jun 27 14:56:41.686485 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 70/135] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:41 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:41.749936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d69bdeb0-4c3a-42a8-8170-e316137513bd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:41.750470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d69bdeb0-4c3a-42a8-8170-e316137513bd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:41.756593 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d69bdeb0-4c3a-42a8-8170-e316137513bd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:41.757073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d69bdeb0-4c3a-42a8-8170-e316137513bd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:41.761434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d69bdeb0-4c3a-42a8-8170-e316137513bd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:41.761434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d69bdeb0-4c3a-42a8-8170-e316137513bd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:41.889173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d69bdeb0-4c3a-42a8-8170-e316137513bd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:41.896596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d69bdeb0-4c3a-42a8-8170-e316137513bd tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.150557 Jun 27 14:56:41.897301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 66/136] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:41 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:42.124740 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-695368113", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "networks": [{"uuid": "02214fe4-f4f9-4514-ae46-ea69498e3933"}]}} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:42.175901 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.network.neutron [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] validate_networks() for [('02214fe4-f4f9-4514-ae46-ea69498e3933', None, None, None, None, None)] {{(pid=129686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:56:42.471398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:42.472005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:42.478065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.478516 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.479273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.479706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.531151 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Flavor limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:56:42.531644 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Image limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:56:42.532029 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Flavor pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:56:42.532464 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Image pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:56:42.532902 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:56:42.537159 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_api:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:42.544827 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.546063 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.546867 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.547309 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.566475 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Getting quotas for project 88f69fa608db4724a066a8dde7efe38a. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:56:42.570102 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Getting quotas for user e7c4678d1aa9425db97adc6cce76e74f and project 88f69fa608db4724a066a8dde7efe38a. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:56:42.582687 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Going to run 1 instances... {{(pid=129686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:56:42.585034 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:56:42.635352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:42.643955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:42.645481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:42.646576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5bd1732f-e225-443d-bac6-7341756dbdc1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.180550 Jun 27 14:56:42.647131 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 67/137] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:42 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:42.651672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-80aa6863-abc0-4353-ad2a-591e608c0464 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:42.652263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-80aa6863-abc0-4353-ad2a-591e608c0464 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:42.658288 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80aa6863-abc0-4353-ad2a-591e608c0464 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.658734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80aa6863-abc0-4353-ad2a-591e608c0464 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.659534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80aa6863-abc0-4353-ad2a-591e608c0464 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.659964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80aa6863-abc0-4353-ad2a-591e608c0464 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.694344 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-0ede558d-968a-4bee-8bb5-fe782ae4fc22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573614 Jun 27 14:56:42.695258 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 71/138] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:56:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 14:56:42.708538 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-bd97234d-1058-4e17-aa38-77a91644da9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:42.709182 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-bd97234d-1058-4e17-aa38-77a91644da9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:42.716012 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bd97234d-1058-4e17-aa38-77a91644da9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.717379 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bd97234d-1058-4e17-aa38-77a91644da9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.718438 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bd97234d-1058-4e17-aa38-77a91644da9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.718879 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bd97234d-1058-4e17-aa38-77a91644da9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.841562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-80aa6863-abc0-4353-ad2a-591e608c0464 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:42.849813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-80aa6863-abc0-4353-ad2a-591e608c0464 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.201561 Jun 27 14:56:42.850433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 68/139] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:42 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:42.856332 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6d2dbb84-9722-467c-a097-d34924786e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:42.857059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6d2dbb84-9722-467c-a097-d34924786e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:42.868119 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-bd97234d-1058-4e17-aa38-77a91644da9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:42.876327 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-bd97234d-1058-4e17-aa38-77a91644da9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.175118 Jun 27 14:56:42.876941 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 72/140] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:42 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:42.915126 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-3cce07c9-2a9d-4c12-a594-8710d88dfd31 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:42.915734 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-3cce07c9-2a9d-4c12-a594-8710d88dfd31 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:42.921806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6d2dbb84-9722-467c-a097-d34924786e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:42.925787 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3cce07c9-2a9d-4c12-a594-8710d88dfd31 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.926240 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3cce07c9-2a9d-4c12-a594-8710d88dfd31 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.926996 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3cce07c9-2a9d-4c12-a594-8710d88dfd31 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:42.927425 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3cce07c9-2a9d-4c12-a594-8710d88dfd31 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:42.929809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6d2dbb84-9722-467c-a097-d34924786e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1218 microversion: 2.1 time: 0.077589 Jun 27 14:56:42.930860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 69/141] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:42 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:43.079751 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-3cce07c9-2a9d-4c12-a594-8710d88dfd31 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:43.098656 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-3cce07c9-2a9d-4c12-a594-8710d88dfd31 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.187463 Jun 27 14:56:43.099211 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 73/142] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:42 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:43.666585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:43.667005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:43.673816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:43.674260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:43.675031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:43.675456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:43.804339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:43.812352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:43.813878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:43.814957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ca17239f-397a-48f0-babf-80c4089a2e1d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.153919 Jun 27 14:56:43.815758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 70/143] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:43 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:43.867129 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-bbeb5da0-a725-4f86-828e-879b72409302 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:43.868934 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-bbeb5da0-a725-4f86-828e-879b72409302 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:43.876139 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bbeb5da0-a725-4f86-828e-879b72409302 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:43.876599 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bbeb5da0-a725-4f86-828e-879b72409302 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:43.877396 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bbeb5da0-a725-4f86-828e-879b72409302 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:43.877825 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bbeb5da0-a725-4f86-828e-879b72409302 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:43.894283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-81e7f31d-3b61-478a-b048-ccce42891580 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:43.895036 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-81e7f31d-3b61-478a-b048-ccce42891580 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:43.898066 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:43.903559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81e7f31d-3b61-478a-b048-ccce42891580 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:43.913439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81e7f31d-3b61-478a-b048-ccce42891580 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:43.914636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81e7f31d-3b61-478a-b048-ccce42891580 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:43.915224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81e7f31d-3b61-478a-b048-ccce42891580 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:44.258029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-81e7f31d-3b61-478a-b048-ccce42891580 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:44.267691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-81e7f31d-3b61-478a-b048-ccce42891580 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.376704 Jun 27 14:56:44.268552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 71/144] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:43 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:44.282661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-47435a4e-7995-4e8b-864a-68e6915e1287 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:44.283339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-47435a4e-7995-4e8b-864a-68e6915e1287 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:44.296564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47435a4e-7995-4e8b-864a-68e6915e1287 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:44.296564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47435a4e-7995-4e8b-864a-68e6915e1287 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:44.296564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47435a4e-7995-4e8b-864a-68e6915e1287 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:44.297249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47435a4e-7995-4e8b-864a-68e6915e1287 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:44.352368 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-bbeb5da0-a725-4f86-828e-879b72409302 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:44.360157 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-bbeb5da0-a725-4f86-828e-879b72409302 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.497035 Jun 27 14:56:44.361059 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 74/145] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:43 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:44.364149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-47435a4e-7995-4e8b-864a-68e6915e1287 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:44.366255 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-421957bb-ac7e-4fc8-8a24-01126da1b02e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:44.367335 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-421957bb-ac7e-4fc8-8a24-01126da1b02e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:44.373748 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-421957bb-ac7e-4fc8-8a24-01126da1b02e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:44.374682 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-421957bb-ac7e-4fc8-8a24-01126da1b02e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:44.375656 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-421957bb-ac7e-4fc8-8a24-01126da1b02e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:44.376189 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-421957bb-ac7e-4fc8-8a24-01126da1b02e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:44.387280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-47435a4e-7995-4e8b-864a-68e6915e1287 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1214 microversion: 2.1 time: 0.108786 Jun 27 14:56:44.387877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 72/146] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:44 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:44.837167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:44.838317 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:44.855728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:44.855728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:44.855728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:44.855728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:44.877011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:44.889968 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-421957bb-ac7e-4fc8-8a24-01126da1b02e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:44.902146 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-421957bb-ac7e-4fc8-8a24-01126da1b02e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.534714 Jun 27 14:56:44.902146 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 75/147] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:44 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:45.007735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:45.017704 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:45.019706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:45.031245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ce139711-4dbe-4e00-8397-641afc56e542 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.192068 Jun 27 14:56:45.031245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 73/148] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:44 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:45.285308 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-fc3ec560-9d01-4cbb-8364-3c820842693c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:45.286165 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-fc3ec560-9d01-4cbb-8364-3c820842693c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:45.293007 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fc3ec560-9d01-4cbb-8364-3c820842693c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:45.293854 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fc3ec560-9d01-4cbb-8364-3c820842693c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:45.295456 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fc3ec560-9d01-4cbb-8364-3c820842693c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:45.296480 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fc3ec560-9d01-4cbb-8364-3c820842693c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:45.388583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f29a08d6-006b-422a-8517-26ac9a683262 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:45.390944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f29a08d6-006b-422a-8517-26ac9a683262 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:45.404982 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f29a08d6-006b-422a-8517-26ac9a683262 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:45.407026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f29a08d6-006b-422a-8517-26ac9a683262 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:45.415404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f29a08d6-006b-422a-8517-26ac9a683262 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:45.418573 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f29a08d6-006b-422a-8517-26ac9a683262 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:45.489830 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fc3ec560-9d01-4cbb-8364-3c820842693c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:45.499661 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-fc3ec560-9d01-4cbb-8364-3c820842693c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.218020 Jun 27 14:56:45.500345 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 76/149] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:45 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:45.513178 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e8f2faaf-145a-4107-beb4-2536d2ab9159 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:45.514887 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e8f2faaf-145a-4107-beb4-2536d2ab9159 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:45.521484 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e8f2faaf-145a-4107-beb4-2536d2ab9159 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:45.522274 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e8f2faaf-145a-4107-beb4-2536d2ab9159 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:45.523238 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e8f2faaf-145a-4107-beb4-2536d2ab9159 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:45.523824 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e8f2faaf-145a-4107-beb4-2536d2ab9159 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:45.590473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f29a08d6-006b-422a-8517-26ac9a683262 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:45.599616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f29a08d6-006b-422a-8517-26ac9a683262 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.225587 Jun 27 14:56:45.600207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 74/150] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:45 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:45.604358 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e8f2faaf-145a-4107-beb4-2536d2ab9159 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:45.613658 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e8f2faaf-145a-4107-beb4-2536d2ab9159 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.111983 Jun 27 14:56:45.614501 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 77/151] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:45 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:45.671069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-7c0a1ef0-5103-483a-88aa-0bebb5988059 req-50142216-210a-4853-8421-4dbe715193ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fe8f1e-a283-4606-bc7f-fc3900da88fc", "name": "network-vif-plugged", "status": "completed", "tag": "4f50000a-d5a7-4cf4-a7ef-66f62c841dfe"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:45.679098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-7c0a1ef0-5103-483a-88aa-0bebb5988059 req-50142216-210a-4853-8421-4dbe715193ca service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:45.679652 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-7c0a1ef0-5103-483a-88aa-0bebb5988059 req-50142216-210a-4853-8421-4dbe715193ca service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:45.691601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-7c0a1ef0-5103-483a-88aa-0bebb5988059 req-50142216-210a-4853-8421-4dbe715193ca service nova] Creating event network-vif-plugged:4f50000a-d5a7-4cf4-a7ef-66f62c841dfe for instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc on hv-cinder-79760 Jun 27 14:56:45.696469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-7c0a1ef0-5103-483a-88aa-0bebb5988059 req-50142216-210a-4853-8421-4dbe715193ca service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089102 Jun 27 14:56:45.697085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 75/152] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:56:45.914505 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-50ba3714-2031-4e0e-a48e-e0ca7db1297a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:45.915278 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-50ba3714-2031-4e0e-a48e-e0ca7db1297a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:45.922489 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-50ba3714-2031-4e0e-a48e-e0ca7db1297a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:45.922934 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-50ba3714-2031-4e0e-a48e-e0ca7db1297a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:45.924140 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-50ba3714-2031-4e0e-a48e-e0ca7db1297a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:45.924799 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-50ba3714-2031-4e0e-a48e-e0ca7db1297a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:46.044489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:46.046843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:46.054923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:46.055498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:46.057062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:46.057351 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:46.083131 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-50ba3714-2031-4e0e-a48e-e0ca7db1297a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:46.094798 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-50ba3714-2031-4e0e-a48e-e0ca7db1297a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.184582 Jun 27 14:56:46.095399 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 78/153] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:45 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:46.252945 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:46.253581 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:46.255239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:46.256598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-97da9396-b2bf-4807-8d36-a076014efb3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.219464 Jun 27 14:56:46.257530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 76/154] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:46 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:46.518052 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6e5d1c6b-08aa-4ed2-bceb-a4200894f7ac tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:46.518906 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6e5d1c6b-08aa-4ed2-bceb-a4200894f7ac tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:46.526022 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6e5d1c6b-08aa-4ed2-bceb-a4200894f7ac tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:46.526977 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6e5d1c6b-08aa-4ed2-bceb-a4200894f7ac tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:46.527685 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6e5d1c6b-08aa-4ed2-bceb-a4200894f7ac tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:46.528411 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6e5d1c6b-08aa-4ed2-bceb-a4200894f7ac tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:46.618082 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-954e0881-9b0c-4987-858b-b4795f8be250 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:46.618682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-954e0881-9b0c-4987-858b-b4795f8be250 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:46.625021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-954e0881-9b0c-4987-858b-b4795f8be250 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:46.625699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-954e0881-9b0c-4987-858b-b4795f8be250 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:46.627266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-954e0881-9b0c-4987-858b-b4795f8be250 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:46.628455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-954e0881-9b0c-4987-858b-b4795f8be250 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:46.682916 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6e5d1c6b-08aa-4ed2-bceb-a4200894f7ac tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:46.691229 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6e5d1c6b-08aa-4ed2-bceb-a4200894f7ac tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.178146 Jun 27 14:56:46.691812 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 79/155] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:46 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:46.696276 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-db417ef8-0a9d-4444-8835-7cd6277c3ce1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:46.696917 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-db417ef8-0a9d-4444-8835-7cd6277c3ce1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:46.703639 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-db417ef8-0a9d-4444-8835-7cd6277c3ce1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:46.704087 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-db417ef8-0a9d-4444-8835-7cd6277c3ce1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:46.704873 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-db417ef8-0a9d-4444-8835-7cd6277c3ce1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:46.705305 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-db417ef8-0a9d-4444-8835-7cd6277c3ce1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:46.709321 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:46.774597 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-db417ef8-0a9d-4444-8835-7cd6277c3ce1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:46.783647 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-db417ef8-0a9d-4444-8835-7cd6277c3ce1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.090783 Jun 27 14:56:46.793541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-954e0881-9b0c-4987-858b-b4795f8be250 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:46.793775 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 80/156] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:46 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:46.803080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-954e0881-9b0c-4987-858b-b4795f8be250 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.188577 Jun 27 14:56:46.813807 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 77/157] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:46 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:47.111440 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4b896057-5398-49b1-af1e-f2e7ad7772d4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:47.112048 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4b896057-5398-49b1-af1e-f2e7ad7772d4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:47.118281 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4b896057-5398-49b1-af1e-f2e7ad7772d4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.118722 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4b896057-5398-49b1-af1e-f2e7ad7772d4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.119481 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4b896057-5398-49b1-af1e-f2e7ad7772d4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.119910 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4b896057-5398-49b1-af1e-f2e7ad7772d4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.252316 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4b896057-5398-49b1-af1e-f2e7ad7772d4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:47.260135 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4b896057-5398-49b1-af1e-f2e7ad7772d4 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.152655 Jun 27 14:56:47.260729 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 81/158] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:47 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:47.275274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:47.276034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:47.282855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.283411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.284389 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.284922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.421189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:47.428987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:47.430471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:47.431564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d5ebeeb7-18f6-449c-ae12-73dbc326ca50 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.160176 Jun 27 14:56:47.432115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 78/159] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:47 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:47.710551 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-99e06cf2-b90a-4001-b907-bb776adf4108 req-03933a78-08da-4460-8653-78a27d2cf8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbec56f5-672a-4067-8656-c5d152daef90", "name": "network-vif-plugged", "status": "completed", "tag": "dc6a0f8d-f77c-413a-9022-cbcffb6de783"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:47.712798 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d5196e96-a05b-4837-a834-1d9ba186e77d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:47.713414 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d5196e96-a05b-4837-a834-1d9ba186e77d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:47.719110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-99e06cf2-b90a-4001-b907-bb776adf4108 req-03933a78-08da-4460-8653-78a27d2cf8b0 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.719748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-99e06cf2-b90a-4001-b907-bb776adf4108 req-03933a78-08da-4460-8653-78a27d2cf8b0 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.720954 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d5196e96-a05b-4837-a834-1d9ba186e77d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.721582 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d5196e96-a05b-4837-a834-1d9ba186e77d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.722509 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d5196e96-a05b-4837-a834-1d9ba186e77d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.723109 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d5196e96-a05b-4837-a834-1d9ba186e77d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.731585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-99e06cf2-b90a-4001-b907-bb776adf4108 req-03933a78-08da-4460-8653-78a27d2cf8b0 service nova] Creating event network-vif-plugged:dc6a0f8d-f77c-413a-9022-cbcffb6de783 for instance bbec56f5-672a-4067-8656-c5d152daef90 on hv-cinder-79760 Jun 27 14:56:47.737416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-99e06cf2-b90a-4001-b907-bb776adf4108 req-03933a78-08da-4460-8653-78a27d2cf8b0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030357 Jun 27 14:56:47.738203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 79/160] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:56:47.800537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f147fa54-2ae1-4c22-84d1-1c9e552965b4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:47.801277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f147fa54-2ae1-4c22-84d1-1c9e552965b4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:47.807446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f147fa54-2ae1-4c22-84d1-1c9e552965b4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.807888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f147fa54-2ae1-4c22-84d1-1c9e552965b4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.808658 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f147fa54-2ae1-4c22-84d1-1c9e552965b4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.809098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f147fa54-2ae1-4c22-84d1-1c9e552965b4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.853703 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d5196e96-a05b-4837-a834-1d9ba186e77d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:47.863670 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d5196e96-a05b-4837-a834-1d9ba186e77d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.159786 Jun 27 14:56:47.875076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 82/161] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:47 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:47.875076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6f0f7fb6-ce94-456e-9354-25354ab719e4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:47.875076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6f0f7fb6-ce94-456e-9354-25354ab719e4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:47.876903 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6f0f7fb6-ce94-456e-9354-25354ab719e4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.877448 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6f0f7fb6-ce94-456e-9354-25354ab719e4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.878452 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6f0f7fb6-ce94-456e-9354-25354ab719e4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:47.879334 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6f0f7fb6-ce94-456e-9354-25354ab719e4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:47.882151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f147fa54-2ae1-4c22-84d1-1c9e552965b4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:47.892825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f147fa54-2ae1-4c22-84d1-1c9e552965b4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.096483 Jun 27 14:56:47.893471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 80/162] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:47 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:48.019501 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6f0f7fb6-ce94-456e-9354-25354ab719e4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:48.026937 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6f0f7fb6-ce94-456e-9354-25354ab719e4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.161584 Jun 27 14:56:48.027496 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 83/163] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:47 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:48.277324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e02e4d7e-69f6-4378-9dbd-3cd903e5b389 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:48.277930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e02e4d7e-69f6-4378-9dbd-3cd903e5b389 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:48.285023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e02e4d7e-69f6-4378-9dbd-3cd903e5b389 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:48.285615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e02e4d7e-69f6-4378-9dbd-3cd903e5b389 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:48.286306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e02e4d7e-69f6-4378-9dbd-3cd903e5b389 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:48.286742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e02e4d7e-69f6-4378-9dbd-3cd903e5b389 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:48.414574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e02e4d7e-69f6-4378-9dbd-3cd903e5b389 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:48.423023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e02e4d7e-69f6-4378-9dbd-3cd903e5b389 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.149546 Jun 27 14:56:48.423615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 81/164] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:48 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:48.450254 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:48.451031 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:48.457567 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:48.458011 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:48.458794 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:48.459226 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:48.593074 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:48.601715 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:48.604264 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:48.604932 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-171f5054-aed6-4ea7-8dd4-f50d8b6edd0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.158194 Jun 27 14:56:48.605654 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 84/165] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:48 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:48.884308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-39727935-c71d-45bf-927b-9fd28ffdcab8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:48.884938 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-39727935-c71d-45bf-927b-9fd28ffdcab8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:48.891001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39727935-c71d-45bf-927b-9fd28ffdcab8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:48.891438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39727935-c71d-45bf-927b-9fd28ffdcab8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:48.892187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39727935-c71d-45bf-927b-9fd28ffdcab8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:48.892613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39727935-c71d-45bf-927b-9fd28ffdcab8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:48.908580 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-b700ee54-18b3-49bc-87dc-6390ea4c2c24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:48.909835 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-b700ee54-18b3-49bc-87dc-6390ea4c2c24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:48.915985 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b700ee54-18b3-49bc-87dc-6390ea4c2c24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:48.916430 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b700ee54-18b3-49bc-87dc-6390ea4c2c24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:48.917216 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b700ee54-18b3-49bc-87dc-6390ea4c2c24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:48.917640 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b700ee54-18b3-49bc-87dc-6390ea4c2c24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:48.982790 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-b700ee54-18b3-49bc-87dc-6390ea4c2c24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:49.001657 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-b700ee54-18b3-49bc-87dc-6390ea4c2c24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.096772 Jun 27 14:56:49.002788 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 85/166] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:48 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:49.037713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-39727935-c71d-45bf-927b-9fd28ffdcab8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:49.043557 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6659a2bd-01e6-4923-b2ef-71f29ea9022e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:49.044210 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6659a2bd-01e6-4923-b2ef-71f29ea9022e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:49.045705 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-39727935-c71d-45bf-927b-9fd28ffdcab8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.164546 Jun 27 14:56:49.046304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 82/167] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:48 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:49.053400 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6659a2bd-01e6-4923-b2ef-71f29ea9022e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:49.053854 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6659a2bd-01e6-4923-b2ef-71f29ea9022e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:49.054824 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6659a2bd-01e6-4923-b2ef-71f29ea9022e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:49.055256 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6659a2bd-01e6-4923-b2ef-71f29ea9022e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:49.188784 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6659a2bd-01e6-4923-b2ef-71f29ea9022e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:49.196462 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6659a2bd-01e6-4923-b2ef-71f29ea9022e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.156764 Jun 27 14:56:49.197058 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 86/168] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:49 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:49.439501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-881d96d6-de84-43dd-bcca-e2e17e10e4a2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:49.440108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-881d96d6-de84-43dd-bcca-e2e17e10e4a2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:49.452832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-881d96d6-de84-43dd-bcca-e2e17e10e4a2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:49.452832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-881d96d6-de84-43dd-bcca-e2e17e10e4a2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:49.452832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-881d96d6-de84-43dd-bcca-e2e17e10e4a2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:49.452832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-881d96d6-de84-43dd-bcca-e2e17e10e4a2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:49.579130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-881d96d6-de84-43dd-bcca-e2e17e10e4a2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:49.587036 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-881d96d6-de84-43dd-bcca-e2e17e10e4a2 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.151544 Jun 27 14:56:49.587695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 83/169] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:49 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:49.622407 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:49.623883 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:49.629808 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:49.630249 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:49.631273 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:49.631747 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:49.767783 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:49.775584 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:49.780241 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:49.780241 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-1d6eb72b-9677-4f44-98fe-dcb06fa5f5c5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.159695 Jun 27 14:56:49.780241 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 87/170] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:49 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:50.018626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4cd7cd0d-c634-4eef-a651-9f6f8d2d0528 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:50.019232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4cd7cd0d-c634-4eef-a651-9f6f8d2d0528 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:50.025356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4cd7cd0d-c634-4eef-a651-9f6f8d2d0528 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.025783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4cd7cd0d-c634-4eef-a651-9f6f8d2d0528 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.026536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4cd7cd0d-c634-4eef-a651-9f6f8d2d0528 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.026965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4cd7cd0d-c634-4eef-a651-9f6f8d2d0528 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.061940 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4f826586-d34d-4543-ad69-e7156b2e6350 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:50.062578 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4f826586-d34d-4543-ad69-e7156b2e6350 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:50.068912 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f826586-d34d-4543-ad69-e7156b2e6350 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.069356 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f826586-d34d-4543-ad69-e7156b2e6350 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.070116 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f826586-d34d-4543-ad69-e7156b2e6350 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.070579 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f826586-d34d-4543-ad69-e7156b2e6350 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.092171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4cd7cd0d-c634-4eef-a651-9f6f8d2d0528 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:50.100192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4cd7cd0d-c634-4eef-a651-9f6f8d2d0528 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.085303 Jun 27 14:56:50.110433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 84/171] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:50 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:50.209131 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4f826586-d34d-4543-ad69-e7156b2e6350 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:50.213606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-90fec809-0909-4cc0-8a54-a4e6de5c590a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:50.214212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-90fec809-0909-4cc0-8a54-a4e6de5c590a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:50.217607 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4f826586-d34d-4543-ad69-e7156b2e6350 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.158768 Jun 27 14:56:50.219589 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 88/172] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:50 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:50.226917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90fec809-0909-4cc0-8a54-a4e6de5c590a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.227454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90fec809-0909-4cc0-8a54-a4e6de5c590a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.228419 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90fec809-0909-4cc0-8a54-a4e6de5c590a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.228971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90fec809-0909-4cc0-8a54-a4e6de5c590a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.362549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-90fec809-0909-4cc0-8a54-a4e6de5c590a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:50.370125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-90fec809-0909-4cc0-8a54-a4e6de5c590a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.160288 Jun 27 14:56:50.370699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 85/173] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:50 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:50.604438 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-33ca95c2-a38c-4b50-9e7b-78916d9e4fad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:50.605055 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-33ca95c2-a38c-4b50-9e7b-78916d9e4fad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:50.611015 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-33ca95c2-a38c-4b50-9e7b-78916d9e4fad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.611459 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-33ca95c2-a38c-4b50-9e7b-78916d9e4fad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.612200 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-33ca95c2-a38c-4b50-9e7b-78916d9e4fad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.612622 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-33ca95c2-a38c-4b50-9e7b-78916d9e4fad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.745316 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-33ca95c2-a38c-4b50-9e7b-78916d9e4fad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:50.753770 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-33ca95c2-a38c-4b50-9e7b-78916d9e4fad tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.153041 Jun 27 14:56:50.754340 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 89/174] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:50 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:50.795230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:50.796017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:50.801941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.802383 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.803132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:50.803555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:50.929427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:50.938033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:50.939530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:50.941004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-22d2cbcd-06dc-4efc-9767-7ceedce4b42b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.149347 Jun 27 14:56:50.941558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 86/175] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:50 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:51.127160 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-2d588449-2d8c-4fe6-aac8-f20e8e38448f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:51.127771 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-2d588449-2d8c-4fe6-aac8-f20e8e38448f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:51.133957 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2d588449-2d8c-4fe6-aac8-f20e8e38448f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.134402 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2d588449-2d8c-4fe6-aac8-f20e8e38448f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:51.135159 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2d588449-2d8c-4fe6-aac8-f20e8e38448f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.135594 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2d588449-2d8c-4fe6-aac8-f20e8e38448f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:51.202938 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-2d588449-2d8c-4fe6-aac8-f20e8e38448f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:51.212157 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-2d588449-2d8c-4fe6-aac8-f20e8e38448f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.089628 Jun 27 14:56:51.212750 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 90/176] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:51 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:51.235648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d78b96e0-f71f-4ab4-9471-3a27e23191e3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:51.236242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d78b96e0-f71f-4ab4-9471-3a27e23191e3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:51.242209 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d78b96e0-f71f-4ab4-9471-3a27e23191e3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.242649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d78b96e0-f71f-4ab4-9471-3a27e23191e3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:51.243395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d78b96e0-f71f-4ab4-9471-3a27e23191e3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.243818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d78b96e0-f71f-4ab4-9471-3a27e23191e3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:51.386012 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-3b49df59-083a-4ada-b320-63c52e5b53a8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:51.386723 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-3b49df59-083a-4ada-b320-63c52e5b53a8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:51.393590 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3b49df59-083a-4ada-b320-63c52e5b53a8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.394127 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3b49df59-083a-4ada-b320-63c52e5b53a8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:51.394602 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d78b96e0-f71f-4ab4-9471-3a27e23191e3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:51.394767 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3b49df59-083a-4ada-b320-63c52e5b53a8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.395376 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3b49df59-083a-4ada-b320-63c52e5b53a8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:51.402800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d78b96e0-f71f-4ab4-9471-3a27e23191e3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.171651 Jun 27 14:56:51.403410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 87/177] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:51 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:51.530968 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-3b49df59-083a-4ada-b320-63c52e5b53a8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:51.538481 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-3b49df59-083a-4ada-b320-63c52e5b53a8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.156284 Jun 27 14:56:51.539283 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 91/178] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:51 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:51.770341 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4376c6e4-48f3-42cb-8c15-4f17c62caeb9 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:51.770984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4376c6e4-48f3-42cb-8c15-4f17c62caeb9 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:51.776898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4376c6e4-48f3-42cb-8c15-4f17c62caeb9 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.777408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4376c6e4-48f3-42cb-8c15-4f17c62caeb9 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:51.778185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4376c6e4-48f3-42cb-8c15-4f17c62caeb9 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.778624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4376c6e4-48f3-42cb-8c15-4f17c62caeb9 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:51.906662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4376c6e4-48f3-42cb-8c15-4f17c62caeb9 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:51.914002 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4376c6e4-48f3-42cb-8c15-4f17c62caeb9 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.147527 Jun 27 14:56:51.914553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 88/179] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:51 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:51.959380 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:51.959973 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:51.966025 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.966496 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:51.967235 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:51.967657 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:52.099782 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:52.108821 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:52.110359 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:52.111437 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-0955a074-924b-4889-8944-dfb56a5b41ae tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.156006 Jun 27 14:56:52.111992 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 92/180] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:51 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:52.229242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-143ed9fe-a9cf-49cb-ac9b-df7b558b3e35 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:52.229845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-143ed9fe-a9cf-49cb-ac9b-df7b558b3e35 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:52.236608 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-143ed9fe-a9cf-49cb-ac9b-df7b558b3e35 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:52.237079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-143ed9fe-a9cf-49cb-ac9b-df7b558b3e35 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:52.241384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-143ed9fe-a9cf-49cb-ac9b-df7b558b3e35 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:52.241384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-143ed9fe-a9cf-49cb-ac9b-df7b558b3e35 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:52.300159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-143ed9fe-a9cf-49cb-ac9b-df7b558b3e35 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:52.307425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-143ed9fe-a9cf-49cb-ac9b-df7b558b3e35 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.082095 Jun 27 14:56:52.308023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 89/181] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:52 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:52.420878 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-510febe6-c10c-444d-9cb4-2e9e00c4f3bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:52.421534 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-510febe6-c10c-444d-9cb4-2e9e00c4f3bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:52.427659 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-510febe6-c10c-444d-9cb4-2e9e00c4f3bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:52.428125 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-510febe6-c10c-444d-9cb4-2e9e00c4f3bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:52.428907 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-510febe6-c10c-444d-9cb4-2e9e00c4f3bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:52.429342 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-510febe6-c10c-444d-9cb4-2e9e00c4f3bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:52.554971 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=2 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:52.559849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cb1e8758-719d-494a-b547-5417256c051c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:52.562628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cb1e8758-719d-494a-b547-5417256c051c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:52.568725 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-510febe6-c10c-444d-9cb4-2e9e00c4f3bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:52.570599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb1e8758-719d-494a-b547-5417256c051c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:52.571212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb1e8758-719d-494a-b547-5417256c051c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:52.572061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb1e8758-719d-494a-b547-5417256c051c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:52.572570 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cb1e8758-719d-494a-b547-5417256c051c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:52.577332 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-510febe6-c10c-444d-9cb4-2e9e00c4f3bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.161310 Jun 27 14:56:52.577906 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 93/182] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:52 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:52.743778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cb1e8758-719d-494a-b547-5417256c051c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:52.751770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cb1e8758-719d-494a-b547-5417256c051c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.198940 Jun 27 14:56:52.752367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 90/183] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:52 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:52.931019 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-0b802c58-0b83-441b-9ccb-724c54e6be2e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:52.931650 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-0b802c58-0b83-441b-9ccb-724c54e6be2e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:52.933500 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=6 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:52.939433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0b802c58-0b83-441b-9ccb-724c54e6be2e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:52.939945 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0b802c58-0b83-441b-9ccb-724c54e6be2e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:52.941076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0b802c58-0b83-441b-9ccb-724c54e6be2e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:52.941500 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0b802c58-0b83-441b-9ccb-724c54e6be2e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:53.073823 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-0b802c58-0b83-441b-9ccb-724c54e6be2e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:53.081843 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-0b802c58-0b83-441b-9ccb-724c54e6be2e tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.155154 Jun 27 14:56:53.082398 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 94/184] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:52 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:53.134132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:53.135349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:53.138257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:53.142855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:53.143298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:53.144299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:53.144758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:53.163093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:53.272607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:53.281427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:53.282918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:53.284140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1ddd1aa1-9bdc-45fe-ab55-d63e9f74e753 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.153926 Jun 27 14:56:53.284719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 91/185] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:53 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:53.323785 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e60518cc-c375-48df-b566-3ae4f0ff0af3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:53.324388 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e60518cc-c375-48df-b566-3ae4f0ff0af3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:53.331026 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e60518cc-c375-48df-b566-3ae4f0ff0af3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:53.331467 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e60518cc-c375-48df-b566-3ae4f0ff0af3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:53.332219 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e60518cc-c375-48df-b566-3ae4f0ff0af3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:53.332679 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e60518cc-c375-48df-b566-3ae4f0ff0af3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:53.394712 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e60518cc-c375-48df-b566-3ae4f0ff0af3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:53.402098 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e60518cc-c375-48df-b566-3ae4f0ff0af3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.082111 Jun 27 14:56:53.402660 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 95/186] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:53 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:53.595017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9981d2d5-0ea6-40f0-a352-c9bbbe502506 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:53.595728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9981d2d5-0ea6-40f0-a352-c9bbbe502506 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:53.601661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9981d2d5-0ea6-40f0-a352-c9bbbe502506 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:53.602097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9981d2d5-0ea6-40f0-a352-c9bbbe502506 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:53.602842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9981d2d5-0ea6-40f0-a352-c9bbbe502506 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:53.603265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9981d2d5-0ea6-40f0-a352-c9bbbe502506 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:53.757084 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9981d2d5-0ea6-40f0-a352-c9bbbe502506 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:53.768178 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-8f2535ef-04f1-4d6e-9fd1-597dced98295 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:53.768810 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-8f2535ef-04f1-4d6e-9fd1-597dced98295 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:53.773881 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9981d2d5-0ea6-40f0-a352-c9bbbe502506 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.183495 Jun 27 14:56:53.774458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 92/187] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:53 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:53.775609 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8f2535ef-04f1-4d6e-9fd1-597dced98295 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:53.776433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8f2535ef-04f1-4d6e-9fd1-597dced98295 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:53.777560 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8f2535ef-04f1-4d6e-9fd1-597dced98295 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:53.778239 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8f2535ef-04f1-4d6e-9fd1-597dced98295 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:53.924623 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-8f2535ef-04f1-4d6e-9fd1-597dced98295 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:53.928586 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:53.933088 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-8f2535ef-04f1-4d6e-9fd1-597dced98295 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.169152 Jun 27 14:56:53.933749 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 96/188] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:53 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:54.099421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-331b8627-1774-4221-b6fe-e486b103bdef tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:54.100128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-331b8627-1774-4221-b6fe-e486b103bdef tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:54.106263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-331b8627-1774-4221-b6fe-e486b103bdef tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.106766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-331b8627-1774-4221-b6fe-e486b103bdef tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:54.108161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-331b8627-1774-4221-b6fe-e486b103bdef tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.108808 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-331b8627-1774-4221-b6fe-e486b103bdef tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:54.262797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-331b8627-1774-4221-b6fe-e486b103bdef tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:54.270413 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-331b8627-1774-4221-b6fe-e486b103bdef tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.174932 Jun 27 14:56:54.270971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 93/189] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:54 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:54.302114 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:54.302845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:54.309110 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.309553 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:54.310888 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.311319 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:54.419419 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-066c70d0-52e0-42be-a2dc-67d44bf5c1e7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:54.421145 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-066c70d0-52e0-42be-a2dc-67d44bf5c1e7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:54.427452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-066c70d0-52e0-42be-a2dc-67d44bf5c1e7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.427893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-066c70d0-52e0-42be-a2dc-67d44bf5c1e7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:54.428689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-066c70d0-52e0-42be-a2dc-67d44bf5c1e7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.429784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-066c70d0-52e0-42be-a2dc-67d44bf5c1e7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:54.443491 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:54.454983 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:54.457178 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:54.458790 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-fb8c8ecd-a467-4b73-84b5-d5fdb0fde88b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.160878 Jun 27 14:56:54.460033 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 97/190] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:54 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:54.499246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-066c70d0-52e0-42be-a2dc-67d44bf5c1e7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:54.507055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-066c70d0-52e0-42be-a2dc-67d44bf5c1e7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.091573 Jun 27 14:56:54.507658 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 94/191] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:54 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:54.791347 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-af0b4eb8-f10a-4d21-adbe-2f96de49d357 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:54.791981 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-af0b4eb8-f10a-4d21-adbe-2f96de49d357 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:54.798682 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-af0b4eb8-f10a-4d21-adbe-2f96de49d357 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.799221 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-af0b4eb8-f10a-4d21-adbe-2f96de49d357 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:54.800146 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-af0b4eb8-f10a-4d21-adbe-2f96de49d357 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.800578 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-af0b4eb8-f10a-4d21-adbe-2f96de49d357 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:54.930232 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-af0b4eb8-f10a-4d21-adbe-2f96de49d357 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:54.938143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-af0b4eb8-f10a-4d21-adbe-2f96de49d357 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.150855 Jun 27 14:56:54.938712 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 98/192] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:54 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:54.950785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-df313a92-1147-4621-8ebd-cde1b8a635ed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:54.951558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-df313a92-1147-4621-8ebd-cde1b8a635ed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:54.958119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df313a92-1147-4621-8ebd-cde1b8a635ed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.958568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df313a92-1147-4621-8ebd-cde1b8a635ed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:54.959328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df313a92-1147-4621-8ebd-cde1b8a635ed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:54.959758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df313a92-1147-4621-8ebd-cde1b8a635ed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:55.096754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-df313a92-1147-4621-8ebd-cde1b8a635ed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:55.104338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-df313a92-1147-4621-8ebd-cde1b8a635ed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.157332 Jun 27 14:56:55.105077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 95/193] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:54 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:55.287927 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-0ef20efa-6d69-4be8-bf5f-a07981e532ac tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:55.288533 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-0ef20efa-6d69-4be8-bf5f-a07981e532ac tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:55.295285 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0ef20efa-6d69-4be8-bf5f-a07981e532ac tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:55.295733 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0ef20efa-6d69-4be8-bf5f-a07981e532ac tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:55.296540 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0ef20efa-6d69-4be8-bf5f-a07981e532ac tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:55.296977 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0ef20efa-6d69-4be8-bf5f-a07981e532ac tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:55.422396 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-0ef20efa-6d69-4be8-bf5f-a07981e532ac tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:55.429873 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-0ef20efa-6d69-4be8-bf5f-a07981e532ac tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.146039 Jun 27 14:56:55.430429 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 99/194] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:55 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:55.478604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:55.479231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:55.485863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:55.486312 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:55.487070 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:55.487504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:55.523249 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6130224e-82d3-4685-90ce-6c119224456d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:55.523850 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6130224e-82d3-4685-90ce-6c119224456d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:55.530581 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6130224e-82d3-4685-90ce-6c119224456d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:55.531259 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6130224e-82d3-4685-90ce-6c119224456d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:55.532024 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6130224e-82d3-4685-90ce-6c119224456d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:55.532454 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6130224e-82d3-4685-90ce-6c119224456d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:55.597545 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6130224e-82d3-4685-90ce-6c119224456d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:55.607293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6130224e-82d3-4685-90ce-6c119224456d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.087735 Jun 27 14:56:55.608415 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 100/195] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:55 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:55.620367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:55.628336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:55.629886 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:55.630993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-829e3d19-f21c-4426-ac15-7e1b88f4dcbc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.156268 Jun 27 14:56:55.631543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 96/196] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:55 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:55.955735 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e3d21f23-460f-4664-ba29-c86dae57196e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:55.956354 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e3d21f23-460f-4664-ba29-c86dae57196e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:55.963481 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e3d21f23-460f-4664-ba29-c86dae57196e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:55.963924 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e3d21f23-460f-4664-ba29-c86dae57196e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:55.964932 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e3d21f23-460f-4664-ba29-c86dae57196e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:55.965335 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e3d21f23-460f-4664-ba29-c86dae57196e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:56.103245 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e3d21f23-460f-4664-ba29-c86dae57196e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:56.112299 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e3d21f23-460f-4664-ba29-c86dae57196e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.161306 Jun 27 14:56:56.112898 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 101/197] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:55 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:56.121950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c1df5d87-afd9-4108-a9c1-0c3ec5ce07e0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:56.122609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c1df5d87-afd9-4108-a9c1-0c3ec5ce07e0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:56.129265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1df5d87-afd9-4108-a9c1-0c3ec5ce07e0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:56.129718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1df5d87-afd9-4108-a9c1-0c3ec5ce07e0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:56.130470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1df5d87-afd9-4108-a9c1-0c3ec5ce07e0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:56.130898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1df5d87-afd9-4108-a9c1-0c3ec5ce07e0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:56.269306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c1df5d87-afd9-4108-a9c1-0c3ec5ce07e0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:56.278003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c1df5d87-afd9-4108-a9c1-0c3ec5ce07e0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.159772 Jun 27 14:56:56.278617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 97/198] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:56 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:56.447606 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-51279fb7-fabe-4a80-bbcf-053f121b3a8f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:56.448240 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-51279fb7-fabe-4a80-bbcf-053f121b3a8f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:56.454789 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-51279fb7-fabe-4a80-bbcf-053f121b3a8f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:56.455351 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-51279fb7-fabe-4a80-bbcf-053f121b3a8f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:56.456112 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-51279fb7-fabe-4a80-bbcf-053f121b3a8f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:56.456542 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-51279fb7-fabe-4a80-bbcf-053f121b3a8f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:56.585086 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-51279fb7-fabe-4a80-bbcf-053f121b3a8f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:56.593176 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-51279fb7-fabe-4a80-bbcf-053f121b3a8f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.149501 Jun 27 14:56:56.593738 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 102/199] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:56 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:56.624612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8844a10e-a763-4e2f-b880-2cc7a1f7be70 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:56.625246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8844a10e-a763-4e2f-b880-2cc7a1f7be70 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:56.631219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8844a10e-a763-4e2f-b880-2cc7a1f7be70 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:56.631664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8844a10e-a763-4e2f-b880-2cc7a1f7be70 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:56.632414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8844a10e-a763-4e2f-b880-2cc7a1f7be70 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:56.632883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8844a10e-a763-4e2f-b880-2cc7a1f7be70 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:56.655485 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:56.656230 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:56.662407 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:56.662832 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:56.663576 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:56.664126 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:56.700286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8844a10e-a763-4e2f-b880-2cc7a1f7be70 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:56.708094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8844a10e-a763-4e2f-b880-2cc7a1f7be70 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.087423 Jun 27 14:56:56.708927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 98/200] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:56 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:56.809148 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:56.817781 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:56.819262 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:56.820343 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-fb7b2e78-c897-4bc9-966c-dd0155939671 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.169405 Jun 27 14:56:56.821157 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 103/201] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:56 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:56:57.129766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4e71616a-8069-4ec0-9208-e7871249deb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:57.130407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4e71616a-8069-4ec0-9208-e7871249deb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:57.136417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e71616a-8069-4ec0-9208-e7871249deb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.136933 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e71616a-8069-4ec0-9208-e7871249deb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.137682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e71616a-8069-4ec0-9208-e7871249deb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.138815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e71616a-8069-4ec0-9208-e7871249deb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.272020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4e71616a-8069-4ec0-9208-e7871249deb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:57.280216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4e71616a-8069-4ec0-9208-e7871249deb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.154457 Jun 27 14:56:57.281827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 99/202] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:57 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:57.296687 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-332faec5-d1b2-4c0b-aa7c-d09c31ce6c0a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:57.296687 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-332faec5-d1b2-4c0b-aa7c-d09c31ce6c0a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:57.302708 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-332faec5-d1b2-4c0b-aa7c-d09c31ce6c0a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.303146 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-332faec5-d1b2-4c0b-aa7c-d09c31ce6c0a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.303957 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-332faec5-d1b2-4c0b-aa7c-d09c31ce6c0a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.304587 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-332faec5-d1b2-4c0b-aa7c-d09c31ce6c0a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.438732 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-332faec5-d1b2-4c0b-aa7c-d09c31ce6c0a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:57.448433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-332faec5-d1b2-4c0b-aa7c-d09c31ce6c0a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.156972 Jun 27 14:56:57.451728 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 104/203] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:57 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:57.609911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2dfa4b26-aab0-491c-ac4f-ad10558e221b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:57.610431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2dfa4b26-aab0-491c-ac4f-ad10558e221b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:57.616400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b26-aab0-491c-ac4f-ad10558e221b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.616877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b26-aab0-491c-ac4f-ad10558e221b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.617623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b26-aab0-491c-ac4f-ad10558e221b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.618049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b26-aab0-491c-ac4f-ad10558e221b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.725623 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e0508185-4dd7-4ad1-a26f-76b3700bf8a7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:57.726477 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e0508185-4dd7-4ad1-a26f-76b3700bf8a7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:57.734786 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e0508185-4dd7-4ad1-a26f-76b3700bf8a7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.735239 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e0508185-4dd7-4ad1-a26f-76b3700bf8a7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.735996 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e0508185-4dd7-4ad1-a26f-76b3700bf8a7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.736423 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e0508185-4dd7-4ad1-a26f-76b3700bf8a7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.775981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2dfa4b26-aab0-491c-ac4f-ad10558e221b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:57.784682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2dfa4b26-aab0-491c-ac4f-ad10558e221b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.178805 Jun 27 14:56:57.786319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 100/204] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:57 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:57.840856 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e0508185-4dd7-4ad1-a26f-76b3700bf8a7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:57.840989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:57.840989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:57.847239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.847689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.848501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:57.848674 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e0508185-4dd7-4ad1-a26f-76b3700bf8a7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.126652 Jun 27 14:56:57.849056 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:57.849523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 105/205] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:57 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:57.990665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:57.999610 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:58.002321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:58.002321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-405dca14-9a0f-4a08-b29a-ca56527891db tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.166466 Jun 27 14:56:58.002870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 101/206] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:57 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:58.300354 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-882686f0-e284-46d6-b571-86766014f915 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:58.300354 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-882686f0-e284-46d6-b571-86766014f915 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:58.306527 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-882686f0-e284-46d6-b571-86766014f915 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:58.307122 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-882686f0-e284-46d6-b571-86766014f915 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:58.307935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-882686f0-e284-46d6-b571-86766014f915 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:58.308551 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-882686f0-e284-46d6-b571-86766014f915 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:58.467523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-eceba3fb-18dc-4b30-ad94-a62bb210c713 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:58.468458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-eceba3fb-18dc-4b30-ad94-a62bb210c713 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:58.484580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eceba3fb-18dc-4b30-ad94-a62bb210c713 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:58.485061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eceba3fb-18dc-4b30-ad94-a62bb210c713 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:58.487018 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eceba3fb-18dc-4b30-ad94-a62bb210c713 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:58.487465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eceba3fb-18dc-4b30-ad94-a62bb210c713 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:58.496798 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-882686f0-e284-46d6-b571-86766014f915 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:58.516412 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-882686f0-e284-46d6-b571-86766014f915 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.221327 Jun 27 14:56:58.517522 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 106/207] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:58 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:58.531690 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-27860690-1f51-4bb7-a099-c2f81063a8aa req-2909973f-d67d-4026-a3ff-7886e42799be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b907368b-2875-4987-b99d-e0fea1a04ccb", "name": "network-vif-plugged", "status": "completed", "tag": "0c35fb63-bff3-4058-ae2f-0b7d051c6f76"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:56:58.540831 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-27860690-1f51-4bb7-a099-c2f81063a8aa req-2909973f-d67d-4026-a3ff-7886e42799be service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:58.541332 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-27860690-1f51-4bb7-a099-c2f81063a8aa req-2909973f-d67d-4026-a3ff-7886e42799be service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:58.555824 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-27860690-1f51-4bb7-a099-c2f81063a8aa req-2909973f-d67d-4026-a3ff-7886e42799be service nova] Creating event network-vif-plugged:0c35fb63-bff3-4058-ae2f-0b7d051c6f76 for instance b907368b-2875-4987-b99d-e0fea1a04ccb on hv-cinder-79760 Jun 27 14:56:58.562213 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-27860690-1f51-4bb7-a099-c2f81063a8aa req-2909973f-d67d-4026-a3ff-7886e42799be service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035000 Jun 27 14:56:58.562803 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 107/208] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:56:58.679701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-eceba3fb-18dc-4b30-ad94-a62bb210c713 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:58.691488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-eceba3fb-18dc-4b30-ad94-a62bb210c713 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.228782 Jun 27 14:56:58.694666 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 102/209] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:58 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:58.804008 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-ba3fefe2-0a6e-441e-8ce6-adf30c4cb2e0 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:58.804814 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-ba3fefe2-0a6e-441e-8ce6-adf30c4cb2e0 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:58.811884 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ba3fefe2-0a6e-441e-8ce6-adf30c4cb2e0 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:58.812326 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ba3fefe2-0a6e-441e-8ce6-adf30c4cb2e0 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:58.815110 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ba3fefe2-0a6e-441e-8ce6-adf30c4cb2e0 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:58.815110 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ba3fefe2-0a6e-441e-8ce6-adf30c4cb2e0 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:58.869418 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a5b891f3-dea6-4684-af14-f9e6a56cd3c4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:58.872368 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a5b891f3-dea6-4684-af14-f9e6a56cd3c4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:58.879817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5b891f3-dea6-4684-af14-f9e6a56cd3c4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:58.881019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5b891f3-dea6-4684-af14-f9e6a56cd3c4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:58.881814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5b891f3-dea6-4684-af14-f9e6a56cd3c4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:58.882245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5b891f3-dea6-4684-af14-f9e6a56cd3c4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:59.014382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a5b891f3-dea6-4684-af14-f9e6a56cd3c4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:59.021132 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ba3fefe2-0a6e-441e-8ce6-adf30c4cb2e0 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:59.030763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a5b891f3-dea6-4684-af14-f9e6a56cd3c4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1270 microversion: 2.1 time: 0.165168 Jun 27 14:56:59.031459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 103/210] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:58 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:56:59.040007 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-ba3fefe2-0a6e-441e-8ce6-adf30c4cb2e0 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.240114 Jun 27 14:56:59.045857 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 108/211] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:58 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:59.049515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:59.050537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:59.056975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:59.057730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:59.058695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:59.059148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:59.406462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:59.414867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:59.416380 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:59.417569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-609d090c-8620-4636-afc7-f27c06855e0f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.385131 Jun 27 14:56:59.418141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 104/212] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:56:59 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:56:59.535995 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-a675c54d-933e-47b8-acc4-0b1f35fad909 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:59.536630 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-a675c54d-933e-47b8-acc4-0b1f35fad909 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:59.543074 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a675c54d-933e-47b8-acc4-0b1f35fad909 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:59.543527 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a675c54d-933e-47b8-acc4-0b1f35fad909 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:59.544273 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a675c54d-933e-47b8-acc4-0b1f35fad909 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:59.545279 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a675c54d-933e-47b8-acc4-0b1f35fad909 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:59.710834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b2bf82e0-6b46-4a4e-a232-34fe9b962885 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:56:59.711896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b2bf82e0-6b46-4a4e-a232-34fe9b962885 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:56:59.719940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b2bf82e0-6b46-4a4e-a232-34fe9b962885 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:59.719940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b2bf82e0-6b46-4a4e-a232-34fe9b962885 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:59.720445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b2bf82e0-6b46-4a4e-a232-34fe9b962885 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:56:59.720970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b2bf82e0-6b46-4a4e-a232-34fe9b962885 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:56:59.786313 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-a675c54d-933e-47b8-acc4-0b1f35fad909 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:59.793794 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-a675c54d-933e-47b8-acc4-0b1f35fad909 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.263752 Jun 27 14:56:59.794425 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 109/213] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:59 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:56:59.865429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b2bf82e0-6b46-4a4e-a232-34fe9b962885 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:56:59.873314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b2bf82e0-6b46-4a4e-a232-34fe9b962885 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.167114 Jun 27 14:56:59.874276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 105/214] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:56:59 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:00.051219 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-22f505d8-407f-4df6-8c02-7df097890142 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:00.051835 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-22f505d8-407f-4df6-8c02-7df097890142 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:00.059069 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-22f505d8-407f-4df6-8c02-7df097890142 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.062041 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-22f505d8-407f-4df6-8c02-7df097890142 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.062923 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-22f505d8-407f-4df6-8c02-7df097890142 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.063273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d05ac445-8ad3-4972-af43-7a35e2cb6165 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:00.063383 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-22f505d8-407f-4df6-8c02-7df097890142 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.063917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d05ac445-8ad3-4972-af43-7a35e2cb6165 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:00.071991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d05ac445-8ad3-4972-af43-7a35e2cb6165 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.072911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d05ac445-8ad3-4972-af43-7a35e2cb6165 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.074226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d05ac445-8ad3-4972-af43-7a35e2cb6165 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.075083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d05ac445-8ad3-4972-af43-7a35e2cb6165 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.150613 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-22f505d8-407f-4df6-8c02-7df097890142 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:00.161827 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-22f505d8-407f-4df6-8c02-7df097890142 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1276 microversion: 2.1 time: 0.115153 Jun 27 14:57:00.162503 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 110/215] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:00 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:00.228831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d05ac445-8ad3-4972-af43-7a35e2cb6165 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:00.236725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d05ac445-8ad3-4972-af43-7a35e2cb6165 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.178470 Jun 27 14:57:00.237293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 106/216] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:00 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:00.441002 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:00.441919 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:00.449006 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.449468 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.450232 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.450670 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.580575 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:00.588560 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:00.590076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:00.591171 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c62f5681-d470-460f-a419-e9049cb5e250 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.158612 Jun 27 14:57:00.592299 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 111/217] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:00 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:00.671391 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-1f596430-1cba-43ec-a641-d9f3e977abdf req-654d379c-2210-45bc-a6e0-ab59fa359b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebb517f-7c6e-4422-bd09-7bff9a8834ee", "name": "network-vif-plugged", "status": "completed", "tag": "0b060973-e116-470e-9bd4-728c1c0bb917"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:00.679573 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-1f596430-1cba-43ec-a641-d9f3e977abdf req-654d379c-2210-45bc-a6e0-ab59fa359b89 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.680020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-1f596430-1cba-43ec-a641-d9f3e977abdf req-654d379c-2210-45bc-a6e0-ab59fa359b89 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.692064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-1f596430-1cba-43ec-a641-d9f3e977abdf req-654d379c-2210-45bc-a6e0-ab59fa359b89 service nova] Creating event network-vif-plugged:0b060973-e116-470e-9bd4-728c1c0bb917 for instance cebb517f-7c6e-4422-bd09-7bff9a8834ee on hv-cinder-79760 Jun 27 14:57:00.697070 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-1f596430-1cba-43ec-a641-d9f3e977abdf req-654d379c-2210-45bc-a6e0-ab59fa359b89 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030280 Jun 27 14:57:00.697664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 107/218] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:57:00.811151 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-02a1781c-9c69-4306-b0a4-ac7e741656b2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:00.811790 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-02a1781c-9c69-4306-b0a4-ac7e741656b2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:00.819793 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-02a1781c-9c69-4306-b0a4-ac7e741656b2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.820247 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-02a1781c-9c69-4306-b0a4-ac7e741656b2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.821083 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-02a1781c-9c69-4306-b0a4-ac7e741656b2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.821523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-02a1781c-9c69-4306-b0a4-ac7e741656b2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.891805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3ebffd7c-8f40-4dcc-945f-c0ba40d9545d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:00.892593 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3ebffd7c-8f40-4dcc-945f-c0ba40d9545d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:00.898885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ebffd7c-8f40-4dcc-945f-c0ba40d9545d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.899427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ebffd7c-8f40-4dcc-945f-c0ba40d9545d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.900184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ebffd7c-8f40-4dcc-945f-c0ba40d9545d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:00.900621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ebffd7c-8f40-4dcc-945f-c0ba40d9545d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:00.999586 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-02a1781c-9c69-4306-b0a4-ac7e741656b2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:01.007282 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-02a1781c-9c69-4306-b0a4-ac7e741656b2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.200735 Jun 27 14:57:01.007852 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 112/219] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:00 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:01.049733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3ebffd7c-8f40-4dcc-945f-c0ba40d9545d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:01.053221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:01.057633 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3ebffd7c-8f40-4dcc-945f-c0ba40d9545d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.171128 Jun 27 14:57:01.058198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 108/220] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:00 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:01.180365 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e6e3eb7e-8ef7-495a-87d5-93d8512b016e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:01.181066 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e6e3eb7e-8ef7-495a-87d5-93d8512b016e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:01.187854 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e6e3eb7e-8ef7-495a-87d5-93d8512b016e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:01.188297 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e6e3eb7e-8ef7-495a-87d5-93d8512b016e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:01.189096 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e6e3eb7e-8ef7-495a-87d5-93d8512b016e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:01.189529 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e6e3eb7e-8ef7-495a-87d5-93d8512b016e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:01.254792 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e6e3eb7e-8ef7-495a-87d5-93d8512b016e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:01.254980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c180ce35-2262-4e66-ac18-4085102b30f1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:01.255596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c180ce35-2262-4e66-ac18-4085102b30f1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:01.262176 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c180ce35-2262-4e66-ac18-4085102b30f1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:01.262736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c180ce35-2262-4e66-ac18-4085102b30f1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:01.264066 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e6e3eb7e-8ef7-495a-87d5-93d8512b016e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1276 microversion: 2.1 time: 0.086780 Jun 27 14:57:01.264451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c180ce35-2262-4e66-ac18-4085102b30f1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:01.264920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c180ce35-2262-4e66-ac18-4085102b30f1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:01.265034 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 113/221] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:01 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:01.429008 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c180ce35-2262-4e66-ac18-4085102b30f1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:01.436504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c180ce35-2262-4e66-ac18-4085102b30f1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.186100 Jun 27 14:57:01.437093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 109/222] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:01 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:01.609764 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:01.610379 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:01.616556 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:01.617024 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:01.617801 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:01.618226 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:01.625129 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:01.757989 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:01.767373 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:01.768822 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:01.769929 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-aeb3c810-051a-4288-8ac9-99a1a0eb5c6f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.164428 Jun 27 14:57:01.770473 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 114/223] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:01 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:02.025044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-52a58381-269e-400b-9896-7ebf3dcbfb19 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:02.025614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-52a58381-269e-400b-9896-7ebf3dcbfb19 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:02.032553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52a58381-269e-400b-9896-7ebf3dcbfb19 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.033032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52a58381-269e-400b-9896-7ebf3dcbfb19 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.033817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52a58381-269e-400b-9896-7ebf3dcbfb19 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.034440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52a58381-269e-400b-9896-7ebf3dcbfb19 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.074954 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-0355fe6a-f8ed-49a1-8c25-2c4d8b02e8b4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:02.075563 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-0355fe6a-f8ed-49a1-8c25-2c4d8b02e8b4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:02.079766 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:02.083450 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0355fe6a-f8ed-49a1-8c25-2c4d8b02e8b4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.083905 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0355fe6a-f8ed-49a1-8c25-2c4d8b02e8b4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.084722 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0355fe6a-f8ed-49a1-8c25-2c4d8b02e8b4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.085156 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0355fe6a-f8ed-49a1-8c25-2c4d8b02e8b4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.216960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-52a58381-269e-400b-9896-7ebf3dcbfb19 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:02.226293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-52a58381-269e-400b-9896-7ebf3dcbfb19 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.205027 Jun 27 14:57:02.226877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 110/224] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:02 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:02.237172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-0355fe6a-f8ed-49a1-8c25-2c4d8b02e8b4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:02.244796 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-0355fe6a-f8ed-49a1-8c25-2c4d8b02e8b4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.174046 Jun 27 14:57:02.245364 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 115/225] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:02 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:02.285375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8e7d3fac-074f-40bd-8246-b27efb150a92 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:02.285375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8e7d3fac-074f-40bd-8246-b27efb150a92 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:02.288061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e7d3fac-074f-40bd-8246-b27efb150a92 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.288499 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e7d3fac-074f-40bd-8246-b27efb150a92 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.289271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e7d3fac-074f-40bd-8246-b27efb150a92 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.289696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e7d3fac-074f-40bd-8246-b27efb150a92 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.353656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8e7d3fac-074f-40bd-8246-b27efb150a92 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:02.361618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8e7d3fac-074f-40bd-8246-b27efb150a92 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1276 microversion: 2.1 time: 0.084314 Jun 27 14:57:02.362189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 111/226] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:02 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:02.454580 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-5a819694-25a9-45f5-bcc2-605daddd0450 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:02.455023 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-5a819694-25a9-45f5-bcc2-605daddd0450 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:02.461356 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5a819694-25a9-45f5-bcc2-605daddd0450 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.461812 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5a819694-25a9-45f5-bcc2-605daddd0450 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.462579 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5a819694-25a9-45f5-bcc2-605daddd0450 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.463019 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5a819694-25a9-45f5-bcc2-605daddd0450 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.646340 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-5a819694-25a9-45f5-bcc2-605daddd0450 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:02.654708 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-5a819694-25a9-45f5-bcc2-605daddd0450 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.205057 Jun 27 14:57:02.655518 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 116/227] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:02 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:02.788509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:02.789167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:02.799358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.799358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.799358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:02.799647 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:02.947017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:02.955534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:02.957084 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:02.965017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6ac21300-2289-4cf5-8306-adf74c5332e0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.173695 Jun 27 14:57:02.965017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 112/228] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:02 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:03.244305 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-a4b311ad-0236-4104-ab54-e1afdb9d2810 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:03.244935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-a4b311ad-0236-4104-ab54-e1afdb9d2810 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:03.251934 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a4b311ad-0236-4104-ab54-e1afdb9d2810 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.252372 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a4b311ad-0236-4104-ab54-e1afdb9d2810 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:03.253165 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a4b311ad-0236-4104-ab54-e1afdb9d2810 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.253591 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a4b311ad-0236-4104-ab54-e1afdb9d2810 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:03.262127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6c6cd48b-d996-4012-9d23-6ce4b5c50996 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:03.262729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6c6cd48b-d996-4012-9d23-6ce4b5c50996 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:03.269079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c6cd48b-d996-4012-9d23-6ce4b5c50996 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.269709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c6cd48b-d996-4012-9d23-6ce4b5c50996 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:03.270460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c6cd48b-d996-4012-9d23-6ce4b5c50996 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.271027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c6cd48b-d996-4012-9d23-6ce4b5c50996 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:03.444714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6c6cd48b-d996-4012-9d23-6ce4b5c50996 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:03.455044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6c6cd48b-d996-4012-9d23-6ce4b5c50996 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.196695 Jun 27 14:57:03.457703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 113/229] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:03 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:03.463604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8d1d7806-55fa-462c-a554-0aac51ff538a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:03.465230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8d1d7806-55fa-462c-a554-0aac51ff538a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:03.473681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d1d7806-55fa-462c-a554-0aac51ff538a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.474369 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d1d7806-55fa-462c-a554-0aac51ff538a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:03.475568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d1d7806-55fa-462c-a554-0aac51ff538a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.476086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d1d7806-55fa-462c-a554-0aac51ff538a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:03.533581 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-a4b311ad-0236-4104-ab54-e1afdb9d2810 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:03.541499 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-a4b311ad-0236-4104-ab54-e1afdb9d2810 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.301225 Jun 27 14:57:03.544029 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 117/230] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:03 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:03.546248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8d1d7806-55fa-462c-a554-0aac51ff538a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:03.555222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8d1d7806-55fa-462c-a554-0aac51ff538a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1276 microversion: 2.1 time: 0.096032 Jun 27 14:57:03.556438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 114/231] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:03 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:03.672068 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-8065ede1-c3fa-4829-a3be-d1b9ba8a739d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:03.673092 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-8065ede1-c3fa-4829-a3be-d1b9ba8a739d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:03.681974 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8065ede1-c3fa-4829-a3be-d1b9ba8a739d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.682420 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8065ede1-c3fa-4829-a3be-d1b9ba8a739d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:03.683211 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8065ede1-c3fa-4829-a3be-d1b9ba8a739d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.683637 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8065ede1-c3fa-4829-a3be-d1b9ba8a739d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:03.866379 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-8065ede1-c3fa-4829-a3be-d1b9ba8a739d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:03.875234 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-8065ede1-c3fa-4829-a3be-d1b9ba8a739d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.207504 Jun 27 14:57:03.875853 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 118/232] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:03 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:03.981265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:03.982467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:03.988890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.989386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:03.990159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:03.990588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.156787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:04.164524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:04.166106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:04.167209 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a4faf6d8-cf6a-4c60-bb7f-cce97828de47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.189903 Jun 27 14:57:04.167897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 115/233] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:03 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:04.474008 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-632abb10-9b2a-4f49-91f6-f6909ba703f0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:04.474651 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-632abb10-9b2a-4f49-91f6-f6909ba703f0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:04.487645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-632abb10-9b2a-4f49-91f6-f6909ba703f0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:04.488212 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-632abb10-9b2a-4f49-91f6-f6909ba703f0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.489114 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-632abb10-9b2a-4f49-91f6-f6909ba703f0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:04.489960 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-632abb10-9b2a-4f49-91f6-f6909ba703f0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.558825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-02b20ef0-dbcb-4960-b6b8-ba011b8b1abd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:04.559430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-02b20ef0-dbcb-4960-b6b8-ba011b8b1abd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:04.570528 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02b20ef0-dbcb-4960-b6b8-ba011b8b1abd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:04.570982 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02b20ef0-dbcb-4960-b6b8-ba011b8b1abd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.571751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02b20ef0-dbcb-4960-b6b8-ba011b8b1abd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:04.572185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02b20ef0-dbcb-4960-b6b8-ba011b8b1abd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.682029 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-632abb10-9b2a-4f49-91f6-f6909ba703f0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:04.690586 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-632abb10-9b2a-4f49-91f6-f6909ba703f0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1366 microversion: 2.1 time: 0.220373 Jun 27 14:57:04.701054 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 119/234] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:04 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:04.706840 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-0bc19b39-b426-4fc3-a8ec-a3f98d743349 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:04.707465 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-0bc19b39-b426-4fc3-a8ec-a3f98d743349 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:04.713503 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0bc19b39-b426-4fc3-a8ec-a3f98d743349 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:04.714131 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0bc19b39-b426-4fc3-a8ec-a3f98d743349 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.714896 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0bc19b39-b426-4fc3-a8ec-a3f98d743349 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:04.715328 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0bc19b39-b426-4fc3-a8ec-a3f98d743349 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.747367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-02b20ef0-dbcb-4960-b6b8-ba011b8b1abd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:04.755305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-02b20ef0-dbcb-4960-b6b8-ba011b8b1abd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.200217 Jun 27 14:57:04.759856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 116/235] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:04 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:04.861962 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-0bc19b39-b426-4fc3-a8ec-a3f98d743349 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:04.869292 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-0bc19b39-b426-4fc3-a8ec-a3f98d743349 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.166733 Jun 27 14:57:04.869854 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 120/236] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:04 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:04.891709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-29255f98-4c9c-4cdc-9b22-25b3a361ea0b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:04.892420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-29255f98-4c9c-4cdc-9b22-25b3a361ea0b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:04.899048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29255f98-4c9c-4cdc-9b22-25b3a361ea0b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:04.899898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29255f98-4c9c-4cdc-9b22-25b3a361ea0b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.900525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29255f98-4c9c-4cdc-9b22-25b3a361ea0b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:04.901298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29255f98-4c9c-4cdc-9b22-25b3a361ea0b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.944007 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-a5aafcbb-2a70-4a60-82c5-b953411697a3 req-1270194b-426d-415e-ae7c-41c56656805a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67eac8a-bfba-489d-8d6d-11956e1b4e90", "name": "network-vif-plugged", "status": "completed", "tag": "2f2fac3d-9b57-4c4a-a63d-b53b86aca080"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:04.954829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-a5aafcbb-2a70-4a60-82c5-b953411697a3 req-1270194b-426d-415e-ae7c-41c56656805a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:04.955264 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-a5aafcbb-2a70-4a60-82c5-b953411697a3 req-1270194b-426d-415e-ae7c-41c56656805a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:04.968672 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-a5aafcbb-2a70-4a60-82c5-b953411697a3 req-1270194b-426d-415e-ae7c-41c56656805a service nova] Creating event network-vif-plugged:2f2fac3d-9b57-4c4a-a63d-b53b86aca080 for instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 on hv-cinder-79760 Jun 27 14:57:04.973789 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-a5aafcbb-2a70-4a60-82c5-b953411697a3 req-1270194b-426d-415e-ae7c-41c56656805a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036807 Jun 27 14:57:04.974676 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 121/237] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:57:05.071984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-29255f98-4c9c-4cdc-9b22-25b3a361ea0b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:05.080514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-29255f98-4c9c-4cdc-9b22-25b3a361ea0b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.192720 Jun 27 14:57:05.081198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 117/238] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:04 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:05.186178 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:05.187735 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:05.196635 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:05.197158 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:05.213558 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:05.214010 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:05.414548 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:05.424906 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:05.426423 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:05.427526 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-5280dd40-9a9e-4a51-aab2-de7db3fec22a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.246515 Jun 27 14:57:05.430055 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 122/239] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:05 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:05.708890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0b344eea-9bbb-4520-a9cf-0e5bd51da4c4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:05.709475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0b344eea-9bbb-4520-a9cf-0e5bd51da4c4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:05.715506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b344eea-9bbb-4520-a9cf-0e5bd51da4c4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:05.715944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b344eea-9bbb-4520-a9cf-0e5bd51da4c4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:05.716971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b344eea-9bbb-4520-a9cf-0e5bd51da4c4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:05.717384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b344eea-9bbb-4520-a9cf-0e5bd51da4c4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:05.771980 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-8dddc1b4-a341-44a8-af5a-d3ff7415473f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:05.772581 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-8dddc1b4-a341-44a8-af5a-d3ff7415473f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:05.778811 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8dddc1b4-a341-44a8-af5a-d3ff7415473f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:05.779274 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8dddc1b4-a341-44a8-af5a-d3ff7415473f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:05.780172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8dddc1b4-a341-44a8-af5a-d3ff7415473f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:05.780609 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8dddc1b4-a341-44a8-af5a-d3ff7415473f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:05.863196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0b344eea-9bbb-4520-a9cf-0e5bd51da4c4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:05.870754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0b344eea-9bbb-4520-a9cf-0e5bd51da4c4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1556 microversion: 2.1 time: 0.165960 Jun 27 14:57:05.871449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 118/240] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:05 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:05.886577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bfaa5864-6016-44ab-8424-21a9ee000c78 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:05.887281 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bfaa5864-6016-44ab-8424-21a9ee000c78 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:05.897254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bfaa5864-6016-44ab-8424-21a9ee000c78 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:05.897254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bfaa5864-6016-44ab-8424-21a9ee000c78 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:05.897254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bfaa5864-6016-44ab-8424-21a9ee000c78 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:05.897722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bfaa5864-6016-44ab-8424-21a9ee000c78 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:06.019851 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-8dddc1b4-a341-44a8-af5a-d3ff7415473f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:06.032009 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-8dddc1b4-a341-44a8-af5a-d3ff7415473f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.262752 Jun 27 14:57:06.033155 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 123/241] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:05 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:06.040423 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c293492a-a1ba-4a56-8176-f7c74b7e2c44 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:06.041478 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c293492a-a1ba-4a56-8176-f7c74b7e2c44 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:06.049851 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c293492a-a1ba-4a56-8176-f7c74b7e2c44 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:06.050522 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c293492a-a1ba-4a56-8176-f7c74b7e2c44 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:06.055126 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bfaa5864-6016-44ab-8424-21a9ee000c78 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:06.058072 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c293492a-a1ba-4a56-8176-f7c74b7e2c44 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:06.059245 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c293492a-a1ba-4a56-8176-f7c74b7e2c44 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:06.064117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bfaa5864-6016-44ab-8424-21a9ee000c78 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.181597 Jun 27 14:57:06.074866 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 119/242] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:05 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:06.098130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-87bb1354-8f4f-4c7e-919e-03ef8c900f9f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:06.098741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-87bb1354-8f4f-4c7e-919e-03ef8c900f9f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:06.117765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87bb1354-8f4f-4c7e-919e-03ef8c900f9f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:06.118400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87bb1354-8f4f-4c7e-919e-03ef8c900f9f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:06.119942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87bb1354-8f4f-4c7e-919e-03ef8c900f9f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:06.121847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87bb1354-8f4f-4c7e-919e-03ef8c900f9f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:06.241246 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c293492a-a1ba-4a56-8176-f7c74b7e2c44 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205790 Jun 27 14:57:06.247521 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 124/243] 10.222.0.44 () {58 vars in 1274 bytes} [Mon Jun 27 14:57:06 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:57:06.282316 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-87bb1354-8f4f-4c7e-919e-03ef8c900f9f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:06.292371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-87bb1354-8f4f-4c7e-919e-03ef8c900f9f tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1315 microversion: 2.1 time: 0.198203 Jun 27 14:57:06.292974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 120/244] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:06 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:06.441194 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-7eb7ef67-92f3-4bc3-9ffe-4a2eacc1d148 req-0507e2a9-3da0-4f56-93aa-a39148b323b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9eabcc-8bc7-4501-b977-641ffd6bc5be", "tag": "3441badc-ad12-4d5f-8cd2-2fe530516fbc"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:06.449733 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-7eb7ef67-92f3-4bc3-9ffe-4a2eacc1d148 req-0507e2a9-3da0-4f56-93aa-a39148b323b6 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:06.449919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:06.450341 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-7eb7ef67-92f3-4bc3-9ffe-4a2eacc1d148 req-0507e2a9-3da0-4f56-93aa-a39148b323b6 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:06.451047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:06.457217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:06.461868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:06.461868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:06.461868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:06.461868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:06.470712 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-7eb7ef67-92f3-4bc3-9ffe-4a2eacc1d148 req-0507e2a9-3da0-4f56-93aa-a39148b323b6 service nova] Creating event network-changed:3441badc-ad12-4d5f-8cd2-2fe530516fbc for instance fa9eabcc-8bc7-4501-b977-641ffd6bc5be on hv-cinder-79760 Jun 27 14:57:06.475750 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-7eb7ef67-92f3-4bc3-9ffe-4a2eacc1d148 req-0507e2a9-3da0-4f56-93aa-a39148b323b6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038561 Jun 27 14:57:06.476430 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 125/245] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:57:06.619318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:06.627991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:06.629841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:06.630980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6c3b35a6-4bf5-431d-a9f7-95f317775e26 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.185197 Jun 27 14:57:06.631534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 121/246] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:06 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:57:07.059153 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4ca3864d-2b9f-4e66-88ef-b5106d6772b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:07.062886 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4ca3864d-2b9f-4e66-88ef-b5106d6772b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:07.068495 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4ca3864d-2b9f-4e66-88ef-b5106d6772b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:07.068970 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4ca3864d-2b9f-4e66-88ef-b5106d6772b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:07.069744 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4ca3864d-2b9f-4e66-88ef-b5106d6772b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:07.070363 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4ca3864d-2b9f-4e66-88ef-b5106d6772b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:07.084886 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3a020bae-24fb-434e-b378-aab5f5bbda73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:07.084886 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3a020bae-24fb-434e-b378-aab5f5bbda73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:07.094399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a020bae-24fb-434e-b378-aab5f5bbda73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:07.095084 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a020bae-24fb-434e-b378-aab5f5bbda73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:07.095632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a020bae-24fb-434e-b378-aab5f5bbda73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:07.103105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a020bae-24fb-434e-b378-aab5f5bbda73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:07.253880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3a020bae-24fb-434e-b378-aab5f5bbda73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:07.261330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3a020bae-24fb-434e-b378-aab5f5bbda73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.182881 Jun 27 14:57:07.268706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 122/247] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:07 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:07.309023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b47bd9b5-4c62-45b9-a7a3-6af902bdda07 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:07.313050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b47bd9b5-4c62-45b9-a7a3-6af902bdda07 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:07.317083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b47bd9b5-4c62-45b9-a7a3-6af902bdda07 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:07.318812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b47bd9b5-4c62-45b9-a7a3-6af902bdda07 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:07.318812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b47bd9b5-4c62-45b9-a7a3-6af902bdda07 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:07.318812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b47bd9b5-4c62-45b9-a7a3-6af902bdda07 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:07.393520 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4ca3864d-2b9f-4e66-88ef-b5106d6772b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:07.401722 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4ca3864d-2b9f-4e66-88ef-b5106d6772b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.354869 Jun 27 14:57:07.402437 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 126/248] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:07 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:07.461387 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b47bd9b5-4c62-45b9-a7a3-6af902bdda07 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:07.471593 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b47bd9b5-4c62-45b9-a7a3-6af902bdda07 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1501 microversion: 2.1 time: 0.166353 Jun 27 14:57:07.473690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 123/249] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:07 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:07.650214 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:07.651195 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:07.659226 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:07.660207 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:07.661423 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:07.678426 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:07.891551 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:07.899961 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:07.901777 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:07.903192 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6a2e69d5-27f4-4f76-8af9-a2ca55115e47 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.257178 Jun 27 14:57:07.903786 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 127/250] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:07 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:08.278468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f4c5514c-93c5-47b5-89a9-ccbffa154fb9 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:08.279766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f4c5514c-93c5-47b5-89a9-ccbffa154fb9 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:08.296748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4c5514c-93c5-47b5-89a9-ccbffa154fb9 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:08.297498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4c5514c-93c5-47b5-89a9-ccbffa154fb9 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:08.298405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4c5514c-93c5-47b5-89a9-ccbffa154fb9 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:08.298989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4c5514c-93c5-47b5-89a9-ccbffa154fb9 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:08.421014 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-52a2c5fb-b170-440b-b799-ff44526f66cf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:08.421931 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-52a2c5fb-b170-440b-b799-ff44526f66cf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:08.433988 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-52a2c5fb-b170-440b-b799-ff44526f66cf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:08.434669 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-52a2c5fb-b170-440b-b799-ff44526f66cf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:08.436570 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-52a2c5fb-b170-440b-b799-ff44526f66cf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:08.449080 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-52a2c5fb-b170-440b-b799-ff44526f66cf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:08.482819 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f4c5514c-93c5-47b5-89a9-ccbffa154fb9 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:08.493047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f4c5514c-93c5-47b5-89a9-ccbffa154fb9 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.217513 Jun 27 14:57:08.498553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 124/251] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:08 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:08.509857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-0f71dbac-b0a1-4c26-8c65-3f9da9e73086 req-ba258dd2-261a-4c11-a416-09e2a693a885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fe8f1e-a283-4606-bc7f-fc3900da88fc", "tag": "4f50000a-d5a7-4cf4-a7ef-66f62c841dfe"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:08.530597 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-0f71dbac-b0a1-4c26-8c65-3f9da9e73086 req-ba258dd2-261a-4c11-a416-09e2a693a885 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:08.533083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-0f71dbac-b0a1-4c26-8c65-3f9da9e73086 req-ba258dd2-261a-4c11-a416-09e2a693a885 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:08.553748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-0f71dbac-b0a1-4c26-8c65-3f9da9e73086 req-ba258dd2-261a-4c11-a416-09e2a693a885 service nova] Creating event network-changed:4f50000a-d5a7-4cf4-a7ef-66f62c841dfe for instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc on hv-cinder-79760 Jun 27 14:57:08.559163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-0f71dbac-b0a1-4c26-8c65-3f9da9e73086 req-ba258dd2-261a-4c11-a416-09e2a693a885 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058448 Jun 27 14:57:08.560764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 125/252] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:57:08.657025 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-52a2c5fb-b170-440b-b799-ff44526f66cf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:08.664773 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-52a2c5fb-b170-440b-b799-ff44526f66cf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.249278 Jun 27 14:57:08.665369 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 128/253] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:08 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:08.921515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:08.922205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:08.928405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:08.928882 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:08.929663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:08.930096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:08.934043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:09.085449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:09.094499 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:09.096218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:09.097425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0c3d4c01-af99-413b-9bb0-8321a0c5dc57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.180171 Jun 27 14:57:09.103311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 126/254] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:08 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:09.511628 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-f85dfe77-0d17-417c-b8e2-0425b7d6df1d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:09.512269 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-f85dfe77-0d17-417c-b8e2-0425b7d6df1d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:09.519274 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f85dfe77-0d17-417c-b8e2-0425b7d6df1d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:09.519721 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f85dfe77-0d17-417c-b8e2-0425b7d6df1d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:09.520491 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f85dfe77-0d17-417c-b8e2-0425b7d6df1d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:09.520962 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f85dfe77-0d17-417c-b8e2-0425b7d6df1d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:09.655663 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-f85dfe77-0d17-417c-b8e2-0425b7d6df1d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:09.663044 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-f85dfe77-0d17-417c-b8e2-0425b7d6df1d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.155651 Jun 27 14:57:09.663589 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 129/255] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:09 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:09.681704 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-99dc3043-8fd1-435c-936c-1c9837cfa728 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:09.682311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-99dc3043-8fd1-435c-936c-1c9837cfa728 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:09.688479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99dc3043-8fd1-435c-936c-1c9837cfa728 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:09.688941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99dc3043-8fd1-435c-936c-1c9837cfa728 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:09.689691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99dc3043-8fd1-435c-936c-1c9837cfa728 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:09.690371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99dc3043-8fd1-435c-936c-1c9837cfa728 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:09.822403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-99dc3043-8fd1-435c-936c-1c9837cfa728 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:09.830541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-99dc3043-8fd1-435c-936c-1c9837cfa728 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.152605 Jun 27 14:57:09.831101 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 127/256] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:09 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:10.115921 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:10.116766 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:10.123935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:10.124516 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:10.125335 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:10.125769 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:10.293263 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:10.301816 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:10.303303 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:10.304379 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-16474721-7809-4dea-9181-56632f348b46 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.192734 Jun 27 14:57:10.304963 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 130/257] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:10 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:10.680603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2ad3e2cf-2f52-4eb9-a3bc-b4102df45ea5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:10.681295 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2ad3e2cf-2f52-4eb9-a3bc-b4102df45ea5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:10.687273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ad3e2cf-2f52-4eb9-a3bc-b4102df45ea5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:10.687873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ad3e2cf-2f52-4eb9-a3bc-b4102df45ea5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:10.690350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ad3e2cf-2f52-4eb9-a3bc-b4102df45ea5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:10.690350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ad3e2cf-2f52-4eb9-a3bc-b4102df45ea5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:10.817297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2ad3e2cf-2f52-4eb9-a3bc-b4102df45ea5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:10.824480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2ad3e2cf-2f52-4eb9-a3bc-b4102df45ea5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.147711 Jun 27 14:57:10.825074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 128/258] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:10 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:10.847529 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4d18fcf9-926d-469b-b9e0-fef4a52c6cc4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:10.848134 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4d18fcf9-926d-469b-b9e0-fef4a52c6cc4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:10.854117 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4d18fcf9-926d-469b-b9e0-fef4a52c6cc4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:10.854567 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4d18fcf9-926d-469b-b9e0-fef4a52c6cc4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:10.856471 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4d18fcf9-926d-469b-b9e0-fef4a52c6cc4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:10.856471 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4d18fcf9-926d-469b-b9e0-fef4a52c6cc4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:10.985131 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4d18fcf9-926d-469b-b9e0-fef4a52c6cc4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:10.992533 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4d18fcf9-926d-469b-b9e0-fef4a52c6cc4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.148766 Jun 27 14:57:10.993117 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 131/259] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:10 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:11.322981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:11.323540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:11.330077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:11.330525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:11.331299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:11.331753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:11.464045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:11.476675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:11.478173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:11.483191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1f51723b-f38e-4655-91e3-6467bd294553 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.160343 Jun 27 14:57:11.483191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 129/260] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:11 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:11.841698 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e1a337ce-dc05-4be3-a5c4-574fd8e3693a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:11.842415 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e1a337ce-dc05-4be3-a5c4-574fd8e3693a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:11.849670 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1a337ce-dc05-4be3-a5c4-574fd8e3693a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:11.850257 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1a337ce-dc05-4be3-a5c4-574fd8e3693a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:11.850865 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1a337ce-dc05-4be3-a5c4-574fd8e3693a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:11.851296 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e1a337ce-dc05-4be3-a5c4-574fd8e3693a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:11.868959 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:11.979835 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e1a337ce-dc05-4be3-a5c4-574fd8e3693a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:11.987263 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e1a337ce-dc05-4be3-a5c4-574fd8e3693a tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.149363 Jun 27 14:57:11.987940 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 132/261] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:11 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:12.009422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-47dfab75-4ed4-443c-be70-4fcc8bf57bff tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:12.010053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-47dfab75-4ed4-443c-be70-4fcc8bf57bff tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:12.016605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47dfab75-4ed4-443c-be70-4fcc8bf57bff tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:12.017075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47dfab75-4ed4-443c-be70-4fcc8bf57bff tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:12.017816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47dfab75-4ed4-443c-be70-4fcc8bf57bff tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:12.018241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47dfab75-4ed4-443c-be70-4fcc8bf57bff tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:12.151276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-47dfab75-4ed4-443c-be70-4fcc8bf57bff tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:12.158927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-47dfab75-4ed4-443c-be70-4fcc8bf57bff tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.153489 Jun 27 14:57:12.159479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 130/262] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:12 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:12.503342 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:12.504553 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:12.512900 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:12.512900 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:12.517078 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:12.517078 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:12.647287 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:12.655202 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:12.657096 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:12.658188 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-cc4e7462-4369-4d60-8dc1-f415c34c5652 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.160497 Jun 27 14:57:12.658741 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 133/263] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:12 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:13.003915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fbc77c0b-7b5f-4ddc-8fc3-3a442448fda2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:13.004433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fbc77c0b-7b5f-4ddc-8fc3-3a442448fda2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:13.010465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc77c0b-7b5f-4ddc-8fc3-3a442448fda2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:13.010999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc77c0b-7b5f-4ddc-8fc3-3a442448fda2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:13.011695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc77c0b-7b5f-4ddc-8fc3-3a442448fda2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:13.012132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc77c0b-7b5f-4ddc-8fc3-3a442448fda2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:13.140088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fbc77c0b-7b5f-4ddc-8fc3-3a442448fda2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:13.147438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fbc77c0b-7b5f-4ddc-8fc3-3a442448fda2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.147406 Jun 27 14:57:13.147992 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 131/264] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:12 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:13.176042 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-888e171e-dab9-4b1b-85a8-94d7988ad18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:13.176637 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-888e171e-dab9-4b1b-85a8-94d7988ad18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:13.182666 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-888e171e-dab9-4b1b-85a8-94d7988ad18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:13.183099 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-888e171e-dab9-4b1b-85a8-94d7988ad18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:13.183839 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-888e171e-dab9-4b1b-85a8-94d7988ad18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:13.184260 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-888e171e-dab9-4b1b-85a8-94d7988ad18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:13.312664 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-888e171e-dab9-4b1b-85a8-94d7988ad18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:13.320262 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-888e171e-dab9-4b1b-85a8-94d7988ad18d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.148042 Jun 27 14:57:13.320851 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 134/265] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:13 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:13.675220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:13.675805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:13.681745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:13.682184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:13.682922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:13.683344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:13.990166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:13.997960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:14.000344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:14.001453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ef9c940a-b4af-487d-983a-ed031906c680 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.330065 Jun 27 14:57:14.001999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 132/266] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:13 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:14.165034 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-376f1129-5158-4fe7-98f1-70e7a067ba21 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:14.165670 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-376f1129-5158-4fe7-98f1-70e7a067ba21 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:14.172254 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-376f1129-5158-4fe7-98f1-70e7a067ba21 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:14.172720 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-376f1129-5158-4fe7-98f1-70e7a067ba21 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:14.173500 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-376f1129-5158-4fe7-98f1-70e7a067ba21 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:14.173928 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-376f1129-5158-4fe7-98f1-70e7a067ba21 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:14.300709 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-376f1129-5158-4fe7-98f1-70e7a067ba21 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:14.308004 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-376f1129-5158-4fe7-98f1-70e7a067ba21 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.146940 Jun 27 14:57:14.308593 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 135/267] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:14 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:14.337536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-dfc94b8e-114b-4152-b15b-58c1f54c02c2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:14.338142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-dfc94b8e-114b-4152-b15b-58c1f54c02c2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:14.344723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dfc94b8e-114b-4152-b15b-58c1f54c02c2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:14.345178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dfc94b8e-114b-4152-b15b-58c1f54c02c2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:14.345935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dfc94b8e-114b-4152-b15b-58c1f54c02c2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:14.346368 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dfc94b8e-114b-4152-b15b-58c1f54c02c2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:14.475674 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-dfc94b8e-114b-4152-b15b-58c1f54c02c2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:14.482968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-dfc94b8e-114b-4152-b15b-58c1f54c02c2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.149305 Jun 27 14:57:14.484187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 133/268] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:14 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:15.020665 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:15.021261 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:15.027358 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:15.027858 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:15.028553 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:15.029004 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:15.211227 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:15.219480 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:15.221011 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:15.222104 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6c944ef6-f7e0-4cf4-95b6-d0cbe611a13c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.206014 Jun 27 14:57:15.222653 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 136/269] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:15 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 14:57:15.324192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-00a0d678-aaf5-439c-8fbb-4bb5b597dfe0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:15.324835 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-00a0d678-aaf5-439c-8fbb-4bb5b597dfe0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:15.331505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00a0d678-aaf5-439c-8fbb-4bb5b597dfe0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:15.331942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00a0d678-aaf5-439c-8fbb-4bb5b597dfe0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:15.332720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00a0d678-aaf5-439c-8fbb-4bb5b597dfe0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:15.333155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00a0d678-aaf5-439c-8fbb-4bb5b597dfe0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:15.459017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-00a0d678-aaf5-439c-8fbb-4bb5b597dfe0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:15.466282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-00a0d678-aaf5-439c-8fbb-4bb5b597dfe0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.145897 Jun 27 14:57:15.466846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 134/270] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:15 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:15.501151 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-86f0ba67-697d-4711-96a0-840c99eba2bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:15.501760 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-86f0ba67-697d-4711-96a0-840c99eba2bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:15.507723 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86f0ba67-697d-4711-96a0-840c99eba2bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:15.508169 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86f0ba67-697d-4711-96a0-840c99eba2bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:15.508965 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86f0ba67-697d-4711-96a0-840c99eba2bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:15.509399 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86f0ba67-697d-4711-96a0-840c99eba2bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:15.640145 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-86f0ba67-697d-4711-96a0-840c99eba2bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:15.647676 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-86f0ba67-697d-4711-96a0-840c99eba2bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1321 microversion: 2.1 time: 0.151287 Jun 27 14:57:15.648457 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 137/271] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:15 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:16.240087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:16.240605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:16.246570 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.247010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.247764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.248192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.377186 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:16.385012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:16.386500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:16.387587 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-60076f77-588e-436c-846e-af2952fd4689 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.151521 Jun 27 14:57:16.388143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 135/272] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:16 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:16.482978 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-1618695e-4b97-46f1-8f1a-84fe4cdc8fca tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:16.483813 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-1618695e-4b97-46f1-8f1a-84fe4cdc8fca tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:16.489716 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1618695e-4b97-46f1-8f1a-84fe4cdc8fca tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.490309 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1618695e-4b97-46f1-8f1a-84fe4cdc8fca tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.491046 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1618695e-4b97-46f1-8f1a-84fe4cdc8fca tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.491557 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1618695e-4b97-46f1-8f1a-84fe4cdc8fca tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.623053 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1618695e-4b97-46f1-8f1a-84fe4cdc8fca tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:16.632273 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-1618695e-4b97-46f1-8f1a-84fe4cdc8fca tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.153054 Jun 27 14:57:16.646526 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 138/273] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:16 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:16.664985 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c6552033-8d41-429b-8d68-20c3ec1137f9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:16.665752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c6552033-8d41-429b-8d68-20c3ec1137f9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:16.675823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6552033-8d41-429b-8d68-20c3ec1137f9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.676433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6552033-8d41-429b-8d68-20c3ec1137f9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.677392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6552033-8d41-429b-8d68-20c3ec1137f9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.680506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6552033-8d41-429b-8d68-20c3ec1137f9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.775177 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-96d961b2-691b-401c-bfd8-99aba6af173b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "086c87db-dce1-479e-9424-6a7536b63b09"}} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:16.776433 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-96d961b2-691b-401c-bfd8-99aba6af173b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:16.782966 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-96d961b2-691b-401c-bfd8-99aba6af173b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.784342 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-96d961b2-691b-401c-bfd8-99aba6af173b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.785255 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-96d961b2-691b-401c-bfd8-99aba6af173b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.785693 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-96d961b2-691b-401c-bfd8-99aba6af173b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.856583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c6552033-8d41-429b-8d68-20c3ec1137f9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:16.867014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c6552033-8d41-429b-8d68-20c3ec1137f9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1515 microversion: 2.1 time: 0.205678 Jun 27 14:57:16.867917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 136/274] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:16 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:16.888067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-74552144-8bf7-41ee-ba86-69e9e2fd0945 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:16.889103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-74552144-8bf7-41ee-ba86-69e9e2fd0945 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:16.895768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74552144-8bf7-41ee-ba86-69e9e2fd0945 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.896251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74552144-8bf7-41ee-ba86-69e9e2fd0945 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.897057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74552144-8bf7-41ee-ba86-69e9e2fd0945 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:16.897491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74552144-8bf7-41ee-ba86-69e9e2fd0945 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:16.965724 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-74552144-8bf7-41ee-ba86-69e9e2fd0945 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lazy-loading 'flavor' on Instance uuid cebb517f-7c6e-4422-bd09-7bff9a8834ee {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:57:17.340629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-74552144-8bf7-41ee-ba86-69e9e2fd0945 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee/action" status: 200 len: 32 microversion: 2.1 time: 0.457772 Jun 27 14:57:17.341310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 137/275] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 14:57:16 2022] POST /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee/action => generated 32 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 14:57:17.350895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3d481326-e2b2-478c-a216-66909ada8901 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:17.351582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3d481326-e2b2-478c-a216-66909ada8901 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:17.357671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3d481326-e2b2-478c-a216-66909ada8901 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:17.358735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3d481326-e2b2-478c-a216-66909ada8901 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:17.359494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3d481326-e2b2-478c-a216-66909ada8901 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:17.360023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3d481326-e2b2-478c-a216-66909ada8901 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:17.490414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3d481326-e2b2-478c-a216-66909ada8901 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:17.498148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3d481326-e2b2-478c-a216-66909ada8901 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.151159 Jun 27 14:57:17.512727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 138/276] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:17 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:17.512727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:17.512727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:17.512727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:17.513955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:17.513955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:17.513955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:17.709142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:17.717142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:17.718663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:17.720800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9124ec37-470d-4672-9f1e-922ba8a48834 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1406 microversion: 2.20 time: 0.220794 Jun 27 14:57:17.721364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 139/277] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:17 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:17.725684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d1852fd1-66f8-45c1-99bf-04ec3612b13f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:17.726278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d1852fd1-66f8-45c1-99bf-04ec3612b13f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:17.731948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1852fd1-66f8-45c1-99bf-04ec3612b13f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:17.732393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1852fd1-66f8-45c1-99bf-04ec3612b13f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:17.733210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1852fd1-66f8-45c1-99bf-04ec3612b13f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:17.733644 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1852fd1-66f8-45c1-99bf-04ec3612b13f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:17.866315 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d1852fd1-66f8-45c1-99bf-04ec3612b13f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:17.869844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:17.874122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d1852fd1-66f8-45c1-99bf-04ec3612b13f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.151828 Jun 27 14:57:17.874678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 140/278] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:17 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:18.525955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2ba7a2fb-146a-4d2e-b493-4c9a6da1ef9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:18.526553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2ba7a2fb-146a-4d2e-b493-4c9a6da1ef9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:18.533629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ba7a2fb-146a-4d2e-b493-4c9a6da1ef9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:18.534316 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ba7a2fb-146a-4d2e-b493-4c9a6da1ef9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:18.535380 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ba7a2fb-146a-4d2e-b493-4c9a6da1ef9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:18.536014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ba7a2fb-146a-4d2e-b493-4c9a6da1ef9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:18.766517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2ba7a2fb-146a-4d2e-b493-4c9a6da1ef9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:18.776799 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2ba7a2fb-146a-4d2e-b493-4c9a6da1ef9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.254495 Jun 27 14:57:18.777808 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 141/279] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:18 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:18.784355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:18.785281 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:18.792371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:18.792999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:18.793909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:18.794441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:18.975358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:18.983777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:18.985908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:18.987071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2d8578da-4f14-4315-b07f-667ca3fc1e55 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1598 microversion: 2.20 time: 0.207858 Jun 27 14:57:18.987734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 142/280] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 14:57:18 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1598 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 14:57:18.992182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5ce77c95-3fd2-4c5b-bffa-b3d2ff844435 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:18.992811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5ce77c95-3fd2-4c5b-bffa-b3d2ff844435 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:19.002713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ce77c95-3fd2-4c5b-bffa-b3d2ff844435 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:19.002713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ce77c95-3fd2-4c5b-bffa-b3d2ff844435 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:19.002713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ce77c95-3fd2-4c5b-bffa-b3d2ff844435 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:19.002713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ce77c95-3fd2-4c5b-bffa-b3d2ff844435 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:19.138577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5ce77c95-3fd2-4c5b-bffa-b3d2ff844435 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:19.147387 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5ce77c95-3fd2-4c5b-bffa-b3d2ff844435 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.158628 Jun 27 14:57:19.148080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 143/281] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:18 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:19.162449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-30563b41-54c1-4397-aa1a-c24c844fc85b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:19.162939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-30563b41-54c1-4397-aa1a-c24c844fc85b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:19.169097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-30563b41-54c1-4397-aa1a-c24c844fc85b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:19.169535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-30563b41-54c1-4397-aa1a-c24c844fc85b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:19.170313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-30563b41-54c1-4397-aa1a-c24c844fc85b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:19.170904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-30563b41-54c1-4397-aa1a-c24c844fc85b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:19.198295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-96d961b2-691b-401c-bfd8-99aba6af173b tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "POST /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.427140 Jun 27 14:57:19.199209 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 139/282] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 14:57:16 2022] POST /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb/os-volume_attachments => generated 194 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:57:19.266299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-30563b41-54c1-4397-aa1a-c24c844fc85b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107657 Jun 27 14:57:19.267463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 144/283] 10.222.0.44 () {60 vars in 1315 bytes} [Mon Jun 27 14:57:19 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 14:57:19.817166 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e109e414-9c90-4725-a7db-051e4ee60d54 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:19.817166 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e109e414-9c90-4725-a7db-051e4ee60d54 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:19.817166 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e109e414-9c90-4725-a7db-051e4ee60d54 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:19.817166 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e109e414-9c90-4725-a7db-051e4ee60d54 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:19.817838 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e109e414-9c90-4725-a7db-051e4ee60d54 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:19.817838 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e109e414-9c90-4725-a7db-051e4ee60d54 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:19.982592 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e109e414-9c90-4725-a7db-051e4ee60d54 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:19.994981 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e109e414-9c90-4725-a7db-051e4ee60d54 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.203010 Jun 27 14:57:19.996025 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 140/284] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:19 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:20.169149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-608e1d09-a482-4503-98d7-bc4d140afded tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:20.169757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-608e1d09-a482-4503-98d7-bc4d140afded tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:20.176674 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-608e1d09-a482-4503-98d7-bc4d140afded tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:20.177127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-608e1d09-a482-4503-98d7-bc4d140afded tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:20.177893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-608e1d09-a482-4503-98d7-bc4d140afded tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:20.178327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-608e1d09-a482-4503-98d7-bc4d140afded tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:20.508166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-608e1d09-a482-4503-98d7-bc4d140afded tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:20.515475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-608e1d09-a482-4503-98d7-bc4d140afded tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.350423 Jun 27 14:57:20.516046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 145/285] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:20 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:20.817959 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-d09d6215-5566-4c74-8a24-81c4c72a72bd req-8b56e18b-b841-497e-9908-ef964ae4b9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67eac8a-bfba-489d-8d6d-11956e1b4e90", "tag": "2f2fac3d-9b57-4c4a-a63d-b53b86aca080"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:20.826381 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-d09d6215-5566-4c74-8a24-81c4c72a72bd req-8b56e18b-b841-497e-9908-ef964ae4b9e1 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:20.826825 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-d09d6215-5566-4c74-8a24-81c4c72a72bd req-8b56e18b-b841-497e-9908-ef964ae4b9e1 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:20.838715 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-d09d6215-5566-4c74-8a24-81c4c72a72bd req-8b56e18b-b841-497e-9908-ef964ae4b9e1 service nova] Creating event network-changed:2f2fac3d-9b57-4c4a-a63d-b53b86aca080 for instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 on hv-cinder-79760 Jun 27 14:57:20.844275 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-d09d6215-5566-4c74-8a24-81c4c72a72bd req-8b56e18b-b841-497e-9908-ef964ae4b9e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029557 Jun 27 14:57:20.845307 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 141/286] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:57:21.019897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c9189d83-c422-4b8e-9e31-fae6a56ebe79 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:21.020503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c9189d83-c422-4b8e-9e31-fae6a56ebe79 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:21.026673 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9189d83-c422-4b8e-9e31-fae6a56ebe79 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:21.027117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9189d83-c422-4b8e-9e31-fae6a56ebe79 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:21.028070 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9189d83-c422-4b8e-9e31-fae6a56ebe79 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:21.028508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9189d83-c422-4b8e-9e31-fae6a56ebe79 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:21.189876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c9189d83-c422-4b8e-9e31-fae6a56ebe79 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:21.195901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c9189d83-c422-4b8e-9e31-fae6a56ebe79 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.180471 Jun 27 14:57:21.196473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 146/287] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:21 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:21.532786 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-ebb2dacb-638b-4965-b5fc-5c3418e505c3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:21.533673 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-ebb2dacb-638b-4965-b5fc-5c3418e505c3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:21.540108 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ebb2dacb-638b-4965-b5fc-5c3418e505c3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:21.540610 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ebb2dacb-638b-4965-b5fc-5c3418e505c3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:21.541397 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ebb2dacb-638b-4965-b5fc-5c3418e505c3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:21.541830 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ebb2dacb-638b-4965-b5fc-5c3418e505c3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:21.682881 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ebb2dacb-638b-4965-b5fc-5c3418e505c3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:21.691500 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-ebb2dacb-638b-4965-b5fc-5c3418e505c3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.163020 Jun 27 14:57:21.692075 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 142/288] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:21 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:22.214230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2e4cfcd2-cc38-44fd-8a50-12fc3b177a72 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:22.214844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2e4cfcd2-cc38-44fd-8a50-12fc3b177a72 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:22.221431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e4cfcd2-cc38-44fd-8a50-12fc3b177a72 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:22.221924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e4cfcd2-cc38-44fd-8a50-12fc3b177a72 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:22.222678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e4cfcd2-cc38-44fd-8a50-12fc3b177a72 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:22.223102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e4cfcd2-cc38-44fd-8a50-12fc3b177a72 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:22.376073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2e4cfcd2-cc38-44fd-8a50-12fc3b177a72 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:22.383824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2e4cfcd2-cc38-44fd-8a50-12fc3b177a72 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.173547 Jun 27 14:57:22.384370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 147/289] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:22 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:22.709209 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-2090bc02-0cf0-48ae-909c-287efb39c366 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:22.710070 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-2090bc02-0cf0-48ae-909c-287efb39c366 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:22.716417 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2090bc02-0cf0-48ae-909c-287efb39c366 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:22.716894 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2090bc02-0cf0-48ae-909c-287efb39c366 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:22.717650 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2090bc02-0cf0-48ae-909c-287efb39c366 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:22.718080 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2090bc02-0cf0-48ae-909c-287efb39c366 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:22.852578 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-2090bc02-0cf0-48ae-909c-287efb39c366 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:22.861146 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-2090bc02-0cf0-48ae-909c-287efb39c366 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.155716 Jun 27 14:57:22.861784 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 143/290] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:22 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:23.403993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-92df192b-2a69-4868-9040-429def724a77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:23.404580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-92df192b-2a69-4868-9040-429def724a77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:23.411642 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-92df192b-2a69-4868-9040-429def724a77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:23.412559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-92df192b-2a69-4868-9040-429def724a77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:23.413353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-92df192b-2a69-4868-9040-429def724a77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:23.414200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-92df192b-2a69-4868-9040-429def724a77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:23.563748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-92df192b-2a69-4868-9040-429def724a77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:23.571378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-92df192b-2a69-4868-9040-429def724a77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.172665 Jun 27 14:57:23.571929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 148/291] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:23 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:23.878054 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-256932d2-6814-49f2-b28d-9ef184e44d66 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:23.878655 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-256932d2-6814-49f2-b28d-9ef184e44d66 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:23.886021 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-256932d2-6814-49f2-b28d-9ef184e44d66 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:23.886475 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-256932d2-6814-49f2-b28d-9ef184e44d66 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:23.887274 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-256932d2-6814-49f2-b28d-9ef184e44d66 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:23.887704 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-256932d2-6814-49f2-b28d-9ef184e44d66 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:24.021481 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-256932d2-6814-49f2-b28d-9ef184e44d66 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:24.040502 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-256932d2-6814-49f2-b28d-9ef184e44d66 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.166914 Jun 27 14:57:24.050440 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 144/292] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:23 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:24.590576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-949fce2f-0738-451a-8fcd-169ae59f3329 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:24.591332 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-949fce2f-0738-451a-8fcd-169ae59f3329 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:24.598120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-949fce2f-0738-451a-8fcd-169ae59f3329 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:24.598567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-949fce2f-0738-451a-8fcd-169ae59f3329 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:24.599335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-949fce2f-0738-451a-8fcd-169ae59f3329 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:24.599771 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-949fce2f-0738-451a-8fcd-169ae59f3329 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:24.740420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-949fce2f-0738-451a-8fcd-169ae59f3329 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:24.749110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-949fce2f-0738-451a-8fcd-169ae59f3329 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.164165 Jun 27 14:57:24.750550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 149/293] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:24 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:25.058181 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-2da84f9c-429f-4b62-96ee-71d8e5a7be61 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:25.058792 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-2da84f9c-429f-4b62-96ee-71d8e5a7be61 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:25.069234 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2da84f9c-429f-4b62-96ee-71d8e5a7be61 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:25.069676 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2da84f9c-429f-4b62-96ee-71d8e5a7be61 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:25.070442 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2da84f9c-429f-4b62-96ee-71d8e5a7be61 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:25.070902 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2da84f9c-429f-4b62-96ee-71d8e5a7be61 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:25.210959 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-2da84f9c-429f-4b62-96ee-71d8e5a7be61 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:25.218758 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-2da84f9c-429f-4b62-96ee-71d8e5a7be61 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.164386 Jun 27 14:57:25.219456 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 145/294] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:25 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:25.766877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d6b02f7c-8f72-4b70-9af8-39016bbb0d98 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:25.768116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d6b02f7c-8f72-4b70-9af8-39016bbb0d98 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:25.774745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6b02f7c-8f72-4b70-9af8-39016bbb0d98 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:25.775397 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6b02f7c-8f72-4b70-9af8-39016bbb0d98 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:25.776158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6b02f7c-8f72-4b70-9af8-39016bbb0d98 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:25.776582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6b02f7c-8f72-4b70-9af8-39016bbb0d98 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:25.908919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d6b02f7c-8f72-4b70-9af8-39016bbb0d98 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:25.917269 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d6b02f7c-8f72-4b70-9af8-39016bbb0d98 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.154447 Jun 27 14:57:25.917842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 150/295] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:25 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:26.236109 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e6457a4e-ccbd-4ff8-bcee-70fe7d73a90d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:26.236740 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e6457a4e-ccbd-4ff8-bcee-70fe7d73a90d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:26.242916 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e6457a4e-ccbd-4ff8-bcee-70fe7d73a90d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:26.243523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e6457a4e-ccbd-4ff8-bcee-70fe7d73a90d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:26.244453 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e6457a4e-ccbd-4ff8-bcee-70fe7d73a90d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:26.244925 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e6457a4e-ccbd-4ff8-bcee-70fe7d73a90d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:26.384572 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e6457a4e-ccbd-4ff8-bcee-70fe7d73a90d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:26.394462 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e6457a4e-ccbd-4ff8-bcee-70fe7d73a90d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.163054 Jun 27 14:57:26.395029 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 146/296] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:26 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:26.933538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2a4a5f56-6040-4f56-85b8-67c48cd50609 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:26.934135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2a4a5f56-6040-4f56-85b8-67c48cd50609 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:26.941089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f56-6040-4f56-85b8-67c48cd50609 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:26.941530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f56-6040-4f56-85b8-67c48cd50609 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:26.944125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f56-6040-4f56-85b8-67c48cd50609 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:26.944564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f56-6040-4f56-85b8-67c48cd50609 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:27.075092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2a4a5f56-6040-4f56-85b8-67c48cd50609 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:27.082786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2a4a5f56-6040-4f56-85b8-67c48cd50609 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.153114 Jun 27 14:57:27.083377 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 151/297] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:26 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:27.288543 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-2c50787f-c7d4-4cf1-8433-d76f5e597dbb req-15301d41-72d1-4980-a7ce-d45bac160415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9eabcc-8bc7-4501-b977-641ffd6bc5be", "name": "network-vif-plugged", "status": "completed", "tag": "3441badc-ad12-4d5f-8cd2-2fe530516fbc"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:27.297650 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-2c50787f-c7d4-4cf1-8433-d76f5e597dbb req-15301d41-72d1-4980-a7ce-d45bac160415 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:27.298029 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-2c50787f-c7d4-4cf1-8433-d76f5e597dbb req-15301d41-72d1-4980-a7ce-d45bac160415 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:27.308669 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-2c50787f-c7d4-4cf1-8433-d76f5e597dbb req-15301d41-72d1-4980-a7ce-d45bac160415 service nova] Creating event network-vif-plugged:3441badc-ad12-4d5f-8cd2-2fe530516fbc for instance fa9eabcc-8bc7-4501-b977-641ffd6bc5be on hv-cinder-79760 Jun 27 14:57:27.314215 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-2c50787f-c7d4-4cf1-8433-d76f5e597dbb req-15301d41-72d1-4980-a7ce-d45bac160415 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029450 Jun 27 14:57:27.315072 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 147/298] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:57:27.411215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a789a412-0ed4-42d5-8608-aba54d0b4b09 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:27.411817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a789a412-0ed4-42d5-8608-aba54d0b4b09 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:27.418729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a789a412-0ed4-42d5-8608-aba54d0b4b09 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:27.419167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a789a412-0ed4-42d5-8608-aba54d0b4b09 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:27.419920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a789a412-0ed4-42d5-8608-aba54d0b4b09 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:27.420343 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a789a412-0ed4-42d5-8608-aba54d0b4b09 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:27.553319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a789a412-0ed4-42d5-8608-aba54d0b4b09 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:27.561016 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a789a412-0ed4-42d5-8608-aba54d0b4b09 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.153768 Jun 27 14:57:27.561618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 152/299] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:27 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:28.101138 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-47625436-bfd6-4b61-a8cc-951a6c05640f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:28.101768 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-47625436-bfd6-4b61-a8cc-951a6c05640f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:28.108087 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-47625436-bfd6-4b61-a8cc-951a6c05640f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:28.108529 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-47625436-bfd6-4b61-a8cc-951a6c05640f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:28.109470 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-47625436-bfd6-4b61-a8cc-951a6c05640f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:28.110002 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-47625436-bfd6-4b61-a8cc-951a6c05640f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:28.241594 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-47625436-bfd6-4b61-a8cc-951a6c05640f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:28.249778 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-47625436-bfd6-4b61-a8cc-951a6c05640f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.152855 Jun 27 14:57:28.256951 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 148/300] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:28 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:28.578865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1e726d07-72f8-4fa3-ba11-cc4cd8ed4b4f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:28.579517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1e726d07-72f8-4fa3-ba11-cc4cd8ed4b4f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:28.585472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1e726d07-72f8-4fa3-ba11-cc4cd8ed4b4f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:28.585913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1e726d07-72f8-4fa3-ba11-cc4cd8ed4b4f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:28.586807 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1e726d07-72f8-4fa3-ba11-cc4cd8ed4b4f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:28.587237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1e726d07-72f8-4fa3-ba11-cc4cd8ed4b4f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:28.717099 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1e726d07-72f8-4fa3-ba11-cc4cd8ed4b4f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:28.724722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1e726d07-72f8-4fa3-ba11-cc4cd8ed4b4f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.150457 Jun 27 14:57:28.725279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 153/301] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:28 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:29.267069 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-7ed6b3bf-7902-4ee0-82bb-9aed4012f489 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:29.267705 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-7ed6b3bf-7902-4ee0-82bb-9aed4012f489 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:29.274163 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7ed6b3bf-7902-4ee0-82bb-9aed4012f489 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:29.274611 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7ed6b3bf-7902-4ee0-82bb-9aed4012f489 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:29.275368 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7ed6b3bf-7902-4ee0-82bb-9aed4012f489 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:29.275801 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7ed6b3bf-7902-4ee0-82bb-9aed4012f489 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:29.279740 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:29.404519 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-7ed6b3bf-7902-4ee0-82bb-9aed4012f489 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:29.412397 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-7ed6b3bf-7902-4ee0-82bb-9aed4012f489 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.149324 Jun 27 14:57:29.412979 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 149/302] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:29 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:29.741531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d6ae0ce7-7476-4c67-88b1-0030208c68af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:29.742247 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d6ae0ce7-7476-4c67-88b1-0030208c68af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:29.748273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6ae0ce7-7476-4c67-88b1-0030208c68af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:29.748746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6ae0ce7-7476-4c67-88b1-0030208c68af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:29.749702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6ae0ce7-7476-4c67-88b1-0030208c68af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:29.750157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6ae0ce7-7476-4c67-88b1-0030208c68af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:29.879339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d6ae0ce7-7476-4c67-88b1-0030208c68af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:29.886624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d6ae0ce7-7476-4c67-88b1-0030208c68af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.148950 Jun 27 14:57:29.887261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 154/303] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:29 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:30.430231 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6638b579-f238-4470-b877-3e6227be99c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:30.430839 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6638b579-f238-4470-b877-3e6227be99c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:30.438197 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6638b579-f238-4470-b877-3e6227be99c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:30.438644 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6638b579-f238-4470-b877-3e6227be99c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:30.439400 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6638b579-f238-4470-b877-3e6227be99c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:30.440092 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6638b579-f238-4470-b877-3e6227be99c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:30.565309 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6638b579-f238-4470-b877-3e6227be99c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:30.572669 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6638b579-f238-4470-b877-3e6227be99c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.146673 Jun 27 14:57:30.573231 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 150/304] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:30 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:30.903559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-52720c6d-9b92-45df-97b0-494eb42d0e0e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:30.904163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-52720c6d-9b92-45df-97b0-494eb42d0e0e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:30.910741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52720c6d-9b92-45df-97b0-494eb42d0e0e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:30.911241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52720c6d-9b92-45df-97b0-494eb42d0e0e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:30.911994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52720c6d-9b92-45df-97b0-494eb42d0e0e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:30.912423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52720c6d-9b92-45df-97b0-494eb42d0e0e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:31.188780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-52720c6d-9b92-45df-97b0-494eb42d0e0e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:31.196449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-52720c6d-9b92-45df-97b0-494eb42d0e0e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.297161 Jun 27 14:57:31.200842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 155/305] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:30 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:31.589917 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-54122531-daef-496b-9fb1-3207b8a6b178 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:31.590518 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-54122531-daef-496b-9fb1-3207b8a6b178 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:31.597214 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-54122531-daef-496b-9fb1-3207b8a6b178 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:31.597661 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-54122531-daef-496b-9fb1-3207b8a6b178 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:31.598408 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-54122531-daef-496b-9fb1-3207b8a6b178 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:31.598837 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-54122531-daef-496b-9fb1-3207b8a6b178 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:31.724426 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-54122531-daef-496b-9fb1-3207b8a6b178 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:31.731878 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-54122531-daef-496b-9fb1-3207b8a6b178 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.145799 Jun 27 14:57:31.732437 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 151/306] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:31 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:32.214255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5de8dd62-c794-464e-99d0-40c26ddf9880 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:32.214772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5de8dd62-c794-464e-99d0-40c26ddf9880 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:32.221344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5de8dd62-c794-464e-99d0-40c26ddf9880 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:32.221784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5de8dd62-c794-464e-99d0-40c26ddf9880 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:32.222530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5de8dd62-c794-464e-99d0-40c26ddf9880 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:32.222955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5de8dd62-c794-464e-99d0-40c26ddf9880 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:32.356149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5de8dd62-c794-464e-99d0-40c26ddf9880 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:32.364505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5de8dd62-c794-464e-99d0-40c26ddf9880 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.154252 Jun 27 14:57:32.365098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 156/307] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:32 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:32.748957 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-18838669-78bb-4190-a689-3406cf688f21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:32.749587 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-18838669-78bb-4190-a689-3406cf688f21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:32.751971 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_api:SELECT=73 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:32.756805 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-18838669-78bb-4190-a689-3406cf688f21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:32.757245 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-18838669-78bb-4190-a689-3406cf688f21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:32.757996 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-18838669-78bb-4190-a689-3406cf688f21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:32.758420 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-18838669-78bb-4190-a689-3406cf688f21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:32.891237 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-18838669-78bb-4190-a689-3406cf688f21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:32.898669 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-18838669-78bb-4190-a689-3406cf688f21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.153543 Jun 27 14:57:32.899284 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 152/308] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:32 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:33.381332 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-285739a0-b678-41f5-9276-9872db9cdd36 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:33.381938 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-285739a0-b678-41f5-9276-9872db9cdd36 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:33.387728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-285739a0-b678-41f5-9276-9872db9cdd36 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:33.388171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-285739a0-b678-41f5-9276-9872db9cdd36 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:33.389046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-285739a0-b678-41f5-9276-9872db9cdd36 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:33.389363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-285739a0-b678-41f5-9276-9872db9cdd36 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:33.514928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-285739a0-b678-41f5-9276-9872db9cdd36 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:33.518254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:33.522422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-285739a0-b678-41f5-9276-9872db9cdd36 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.144814 Jun 27 14:57:33.522979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 157/309] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:33 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:33.916423 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c6ab9888-ed8d-4dff-9168-f46722d29b92 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:33.917076 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c6ab9888-ed8d-4dff-9168-f46722d29b92 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:33.924795 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c6ab9888-ed8d-4dff-9168-f46722d29b92 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:33.925954 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c6ab9888-ed8d-4dff-9168-f46722d29b92 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:33.926101 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c6ab9888-ed8d-4dff-9168-f46722d29b92 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:33.926437 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c6ab9888-ed8d-4dff-9168-f46722d29b92 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:34.055012 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c6ab9888-ed8d-4dff-9168-f46722d29b92 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:34.062702 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c6ab9888-ed8d-4dff-9168-f46722d29b92 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.150102 Jun 27 14:57:34.063259 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 153/310] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:33 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:34.542163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5d0612e5-5bdb-47e5-96ca-f9dbf3698db6 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:34.543453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5d0612e5-5bdb-47e5-96ca-f9dbf3698db6 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:34.552824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d0612e5-5bdb-47e5-96ca-f9dbf3698db6 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:34.553512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d0612e5-5bdb-47e5-96ca-f9dbf3698db6 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:34.554496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d0612e5-5bdb-47e5-96ca-f9dbf3698db6 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:34.555164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d0612e5-5bdb-47e5-96ca-f9dbf3698db6 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:34.691640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5d0612e5-5bdb-47e5-96ca-f9dbf3698db6 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:34.705211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5d0612e5-5bdb-47e5-96ca-f9dbf3698db6 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1318 microversion: 2.1 time: 0.168741 Jun 27 14:57:34.705804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 158/311] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:34 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:35.081175 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e71f554f-506d-4896-bae7-673cb849cb80 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:35.082415 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e71f554f-506d-4896-bae7-673cb849cb80 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:35.094965 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e71f554f-506d-4896-bae7-673cb849cb80 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:35.096464 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e71f554f-506d-4896-bae7-673cb849cb80 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:35.098028 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e71f554f-506d-4896-bae7-673cb849cb80 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:35.099168 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e71f554f-506d-4896-bae7-673cb849cb80 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:35.274488 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e71f554f-506d-4896-bae7-673cb849cb80 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:35.286329 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e71f554f-506d-4896-bae7-673cb849cb80 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.210113 Jun 27 14:57:35.287170 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 154/312] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:35 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:35.722810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-68cd103d-62ca-4d6e-b249-a20753cf3454 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:35.723330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-68cd103d-62ca-4d6e-b249-a20753cf3454 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:35.729187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68cd103d-62ca-4d6e-b249-a20753cf3454 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:35.729632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68cd103d-62ca-4d6e-b249-a20753cf3454 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:35.730382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68cd103d-62ca-4d6e-b249-a20753cf3454 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:35.730813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68cd103d-62ca-4d6e-b249-a20753cf3454 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:35.863183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-68cd103d-62ca-4d6e-b249-a20753cf3454 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:35.871180 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-68cd103d-62ca-4d6e-b249-a20753cf3454 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1508 microversion: 2.1 time: 0.152354 Jun 27 14:57:35.871741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 159/313] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:35 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:36.303192 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-7cabcb55-c84f-476a-9be9-e3da3bebd8b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:36.303798 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-7cabcb55-c84f-476a-9be9-e3da3bebd8b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:36.310143 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7cabcb55-c84f-476a-9be9-e3da3bebd8b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:36.310627 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7cabcb55-c84f-476a-9be9-e3da3bebd8b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:36.311383 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7cabcb55-c84f-476a-9be9-e3da3bebd8b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:36.311814 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7cabcb55-c84f-476a-9be9-e3da3bebd8b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:36.444152 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-7cabcb55-c84f-476a-9be9-e3da3bebd8b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:36.451971 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-7cabcb55-c84f-476a-9be9-e3da3bebd8b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.152462 Jun 27 14:57:36.462902 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 155/314] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:36 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:37.470943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-05f44958-6a1e-4a44-8ea9-02a0121a99d5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:37.471558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-05f44958-6a1e-4a44-8ea9-02a0121a99d5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:37.473490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=77 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:37.478191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05f44958-6a1e-4a44-8ea9-02a0121a99d5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:37.478699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05f44958-6a1e-4a44-8ea9-02a0121a99d5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:37.479456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05f44958-6a1e-4a44-8ea9-02a0121a99d5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:37.479890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05f44958-6a1e-4a44-8ea9-02a0121a99d5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:37.608481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-05f44958-6a1e-4a44-8ea9-02a0121a99d5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:37.616461 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-05f44958-6a1e-4a44-8ea9-02a0121a99d5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.149820 Jun 27 14:57:37.617269 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 160/315] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:37 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:38.633618 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-7fed5131-3337-453f-883e-00bee41bbe0b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:38.639933 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-7fed5131-3337-453f-883e-00bee41bbe0b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:38.640726 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7fed5131-3337-453f-883e-00bee41bbe0b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:38.641170 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7fed5131-3337-453f-883e-00bee41bbe0b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:38.642420 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7fed5131-3337-453f-883e-00bee41bbe0b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:38.642844 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7fed5131-3337-453f-883e-00bee41bbe0b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:38.769556 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-7fed5131-3337-453f-883e-00bee41bbe0b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:38.776901 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-7fed5131-3337-453f-883e-00bee41bbe0b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.147349 Jun 27 14:57:38.777459 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 156/316] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:38 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:39.795027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-427ccded-7cda-4811-94ce-d39b0467eb0a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:39.795657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-427ccded-7cda-4811-94ce-d39b0467eb0a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:39.803067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-427ccded-7cda-4811-94ce-d39b0467eb0a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:39.803514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-427ccded-7cda-4811-94ce-d39b0467eb0a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:39.804277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-427ccded-7cda-4811-94ce-d39b0467eb0a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:39.804744 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-427ccded-7cda-4811-94ce-d39b0467eb0a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:39.957094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-427ccded-7cda-4811-94ce-d39b0467eb0a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:39.964958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-427ccded-7cda-4811-94ce-d39b0467eb0a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.173919 Jun 27 14:57:39.965560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 161/317] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:39 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:40.983345 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-992464e7-29a3-4f63-85f3-74108ea317fe tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:40.983940 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-992464e7-29a3-4f63-85f3-74108ea317fe tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:40.991390 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-992464e7-29a3-4f63-85f3-74108ea317fe tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:40.991830 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-992464e7-29a3-4f63-85f3-74108ea317fe tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:40.992584 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-992464e7-29a3-4f63-85f3-74108ea317fe tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:40.993034 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-992464e7-29a3-4f63-85f3-74108ea317fe tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:41.124058 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-992464e7-29a3-4f63-85f3-74108ea317fe tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:41.131948 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-992464e7-29a3-4f63-85f3-74108ea317fe tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.152452 Jun 27 14:57:41.132515 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 157/318] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:40 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:42.149729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a4aa42e2-8fbc-45f0-a58b-b8f88cf8d5bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:42.150336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a4aa42e2-8fbc-45f0-a58b-b8f88cf8d5bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:42.156375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4aa42e2-8fbc-45f0-a58b-b8f88cf8d5bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:42.156871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4aa42e2-8fbc-45f0-a58b-b8f88cf8d5bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:42.157632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4aa42e2-8fbc-45f0-a58b-b8f88cf8d5bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:42.158071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4aa42e2-8fbc-45f0-a58b-b8f88cf8d5bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:42.294386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a4aa42e2-8fbc-45f0-a58b-b8f88cf8d5bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:42.302884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a4aa42e2-8fbc-45f0-a58b-b8f88cf8d5bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.157075 Jun 27 14:57:42.303448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 162/319] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:42 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:42.644530 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-cda72a77-d3bc-4f5f-8a67-0a9d774a5f3d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:42.645078 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-cda72a77-d3bc-4f5f-8a67-0a9d774a5f3d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:42.652135 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-cda72a77-d3bc-4f5f-8a67-0a9d774a5f3d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:42.652694 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-cda72a77-d3bc-4f5f-8a67-0a9d774a5f3d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:42.653599 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-cda72a77-d3bc-4f5f-8a67-0a9d774a5f3d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:42.654139 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-cda72a77-d3bc-4f5f-8a67-0a9d774a5f3d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:42.683183 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-cda72a77-d3bc-4f5f-8a67-0a9d774a5f3d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Going to try to terminate instance {{(pid=129686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 14:57:43.051804 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-cda72a77-d3bc-4f5f-8a67-0a9d774a5f3d tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 204 len: 0 microversion: 2.1 time: 0.412889 Jun 27 14:57:43.052419 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 158/320] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 14:57:42 2022] DELETE /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 14:57:43.060684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8b5cfb58-0f12-4d0b-9605-2e7af37a2572 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:43.061296 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8b5cfb58-0f12-4d0b-9605-2e7af37a2572 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:43.068630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b5cfb58-0f12-4d0b-9605-2e7af37a2572 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:43.069109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b5cfb58-0f12-4d0b-9605-2e7af37a2572 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:43.069869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b5cfb58-0f12-4d0b-9605-2e7af37a2572 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:43.070350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b5cfb58-0f12-4d0b-9605-2e7af37a2572 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:43.206372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8b5cfb58-0f12-4d0b-9605-2e7af37a2572 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:43.214543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8b5cfb58-0f12-4d0b-9605-2e7af37a2572 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1553 microversion: 2.1 time: 0.157805 Jun 27 14:57:43.215094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 163/321] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:43 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:43.321053 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-3e2203ef-a195-4779-91e0-5d6a2920ee59 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:43.321768 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-3e2203ef-a195-4779-91e0-5d6a2920ee59 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:43.328138 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3e2203ef-a195-4779-91e0-5d6a2920ee59 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:43.328679 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3e2203ef-a195-4779-91e0-5d6a2920ee59 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:43.329450 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3e2203ef-a195-4779-91e0-5d6a2920ee59 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:43.329883 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3e2203ef-a195-4779-91e0-5d6a2920ee59 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:43.464183 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-3e2203ef-a195-4779-91e0-5d6a2920ee59 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:43.475927 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-3e2203ef-a195-4779-91e0-5d6a2920ee59 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.159130 Jun 27 14:57:43.476626 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 159/322] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:43 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:44.231184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-900bd8e7-3a5f-4c7c-af81-5ed9cb85f463 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:44.231782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-900bd8e7-3a5f-4c7c-af81-5ed9cb85f463 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:44.237957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-900bd8e7-3a5f-4c7c-af81-5ed9cb85f463 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:44.238409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-900bd8e7-3a5f-4c7c-af81-5ed9cb85f463 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:44.239161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-900bd8e7-3a5f-4c7c-af81-5ed9cb85f463 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:44.239648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-900bd8e7-3a5f-4c7c-af81-5ed9cb85f463 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:44.366831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-900bd8e7-3a5f-4c7c-af81-5ed9cb85f463 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:44.374960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-900bd8e7-3a5f-4c7c-af81-5ed9cb85f463 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1553 microversion: 2.1 time: 0.147495 Jun 27 14:57:44.375552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 164/323] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:44 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:44.495213 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-dee9028c-060b-447e-bea6-91063e450894 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:44.495948 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-dee9028c-060b-447e-bea6-91063e450894 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:44.502601 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-dee9028c-060b-447e-bea6-91063e450894 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:44.503041 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-dee9028c-060b-447e-bea6-91063e450894 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:44.504374 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-dee9028c-060b-447e-bea6-91063e450894 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:44.504835 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-dee9028c-060b-447e-bea6-91063e450894 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:44.635690 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-dee9028c-060b-447e-bea6-91063e450894 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:44.643264 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-dee9028c-060b-447e-bea6-91063e450894 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.151994 Jun 27 14:57:44.643845 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 160/324] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:44 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:45.393125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9ddfa20c-6ef4-4cbb-ad40-879ea7ecef58 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:45.396244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9ddfa20c-6ef4-4cbb-ad40-879ea7ecef58 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:45.401964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ddfa20c-6ef4-4cbb-ad40-879ea7ecef58 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:45.402651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ddfa20c-6ef4-4cbb-ad40-879ea7ecef58 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:45.404194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ddfa20c-6ef4-4cbb-ad40-879ea7ecef58 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:45.404625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ddfa20c-6ef4-4cbb-ad40-879ea7ecef58 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:45.591645 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9ddfa20c-6ef4-4cbb-ad40-879ea7ecef58 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:45.602997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9ddfa20c-6ef4-4cbb-ad40-879ea7ecef58 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1553 microversion: 2.1 time: 0.214265 Jun 27 14:57:45.603496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 165/325] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:45 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:45.661854 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-55cd08a5-6292-4f02-9cee-d650269436bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:45.662459 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-55cd08a5-6292-4f02-9cee-d650269436bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:45.668924 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-55cd08a5-6292-4f02-9cee-d650269436bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:45.669364 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-55cd08a5-6292-4f02-9cee-d650269436bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:45.670109 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-55cd08a5-6292-4f02-9cee-d650269436bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:45.670543 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-55cd08a5-6292-4f02-9cee-d650269436bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:45.912384 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-55cd08a5-6292-4f02-9cee-d650269436bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:45.919907 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-55cd08a5-6292-4f02-9cee-d650269436bc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.262665 Jun 27 14:57:45.920474 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 161/326] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:45 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:46.619384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c64c4aee-3f5e-426e-bf4e-fb890db77696 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:46.619986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c64c4aee-3f5e-426e-bf4e-fb890db77696 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:46.631590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c64c4aee-3f5e-426e-bf4e-fb890db77696 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:46.632205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c64c4aee-3f5e-426e-bf4e-fb890db77696 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:46.633038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c64c4aee-3f5e-426e-bf4e-fb890db77696 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:46.633797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c64c4aee-3f5e-426e-bf4e-fb890db77696 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:46.790200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c64c4aee-3f5e-426e-bf4e-fb890db77696 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:46.798479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c64c4aee-3f5e-426e-bf4e-fb890db77696 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1553 microversion: 2.1 time: 0.182863 Jun 27 14:57:46.799047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 166/327] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:46 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:46.937252 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4e0f4a6c-26be-45f6-8e75-e352f8ad1dd4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:46.937855 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4e0f4a6c-26be-45f6-8e75-e352f8ad1dd4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:46.944878 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4e0f4a6c-26be-45f6-8e75-e352f8ad1dd4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:46.945320 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4e0f4a6c-26be-45f6-8e75-e352f8ad1dd4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:46.946068 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4e0f4a6c-26be-45f6-8e75-e352f8ad1dd4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:46.946490 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4e0f4a6c-26be-45f6-8e75-e352f8ad1dd4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:47.390989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-5955bce5-e69a-4210-b982-305b9ff776e5 req-6435c2bf-d384-4b11-b5bf-845093104750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b907368b-2875-4987-b99d-e0fea1a04ccb", "name": "network-vif-deleted", "tag": "0c35fb63-bff3-4058-ae2f-0b7d051c6f76"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:47.401484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5955bce5-e69a-4210-b982-305b9ff776e5 req-6435c2bf-d384-4b11-b5bf-845093104750 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:47.402195 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5955bce5-e69a-4210-b982-305b9ff776e5 req-6435c2bf-d384-4b11-b5bf-845093104750 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:47.414814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-5955bce5-e69a-4210-b982-305b9ff776e5 req-6435c2bf-d384-4b11-b5bf-845093104750 service nova] Creating event network-vif-deleted:0c35fb63-bff3-4058-ae2f-0b7d051c6f76 for instance b907368b-2875-4987-b99d-e0fea1a04ccb on hv-cinder-79760 Jun 27 14:57:47.416786 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4e0f4a6c-26be-45f6-8e75-e352f8ad1dd4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:47.420388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-5955bce5-e69a-4210-b982-305b9ff776e5 req-6435c2bf-d384-4b11-b5bf-845093104750 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035424 Jun 27 14:57:47.421227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 167/328] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:57:47.425780 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4e0f4a6c-26be-45f6-8e75-e352f8ad1dd4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.492195 Jun 27 14:57:47.426350 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 162/329] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:46 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:47.816234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ea57e881-45ed-438a-9977-e998a7f5f224 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:47.820442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ea57e881-45ed-438a-9977-e998a7f5f224 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:47.823454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea57e881-45ed-438a-9977-e998a7f5f224 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:47.823897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea57e881-45ed-438a-9977-e998a7f5f224 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:47.824668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea57e881-45ed-438a-9977-e998a7f5f224 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:47.825116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea57e881-45ed-438a-9977-e998a7f5f224 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:47.915193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ea57e881-45ed-438a-9977-e998a7f5f224 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:47.932343 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ea57e881-45ed-438a-9977-e998a7f5f224 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1346 microversion: 2.1 time: 0.120629 Jun 27 14:57:47.933179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 168/330] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:47 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:48.447735 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-99642f80-82c3-4b3d-85f5-7c71e9b4e8e8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:48.449023 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-99642f80-82c3-4b3d-85f5-7c71e9b4e8e8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:48.455561 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-99642f80-82c3-4b3d-85f5-7c71e9b4e8e8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:48.456130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-99642f80-82c3-4b3d-85f5-7c71e9b4e8e8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:48.457560 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-99642f80-82c3-4b3d-85f5-7c71e9b4e8e8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:48.458167 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-99642f80-82c3-4b3d-85f5-7c71e9b4e8e8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:48.603222 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-99642f80-82c3-4b3d-85f5-7c71e9b4e8e8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:48.611127 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-99642f80-82c3-4b3d-85f5-7c71e9b4e8e8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.171642 Jun 27 14:57:48.611914 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 163/331] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:48 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:48.949348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:48.949954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:48.962314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:48.967148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:48.968003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:48.968441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:49.022859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:49.023593 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:49.024370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lazy-loading 'fault' on Instance uuid b907368b-2875-4987-b99d-e0fea1a04ccb {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:57:49.089917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340af9c8b53a483d9fc311b36736ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7c4f8156b409785b5555712cdc934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:49.101009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0025f610-ace1-4c58-b07e-064aa76c90f5 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 200 len: 1351 microversion: 2.1 time: 0.155448 Jun 27 14:57:49.101794 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 169/332] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:48 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 1351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:49.629333 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e61c57ee-74e1-4664-9684-83e2d367e5d0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:49.629956 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e61c57ee-74e1-4664-9684-83e2d367e5d0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:49.636336 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e61c57ee-74e1-4664-9684-83e2d367e5d0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:49.636832 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e61c57ee-74e1-4664-9684-83e2d367e5d0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:49.637576 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e61c57ee-74e1-4664-9684-83e2d367e5d0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:49.638031 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e61c57ee-74e1-4664-9684-83e2d367e5d0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:49.642471 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:49.925097 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e61c57ee-74e1-4664-9684-83e2d367e5d0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:49.951175 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e61c57ee-74e1-4664-9684-83e2d367e5d0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.325752 Jun 27 14:57:49.951923 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 164/333] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:49 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:50.119272 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:50.119878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:50.126105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:50.126536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:50.127294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:50.127736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:50.142261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] HTTP exception thrown: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Request method failure captured: Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb HTTP/1.1 Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT_RaeLb-hnu7iy1tvz34fYh4RZEkiusgjtjRoD0sK38lcwYg9b9_iasImchTa9yaFm8Fxt_fg1ty983r8a964cT6aIHW2Kkq8K9fkt6d2bvLcRE_dVwOocHaiqtQiXbDpheCTuImm-S0OlQYs8FmtM50ksCcQyqdKJxr9LN9Ge8Tg Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 27b7c4f8156b409785b5555712cdc934 Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 14:57:50.148333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_27b7c4f8156b409785b5555712cdc934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 27b7c4f8156b409785b5555712cdc934 Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-DeleteServersTestJSON-1083196205-project Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 340af9c8b53a483d9fc311b36736ca01 Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-DeleteServersTestJSON-1083196205-project Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.149634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'b907368b-2875-4987-b99d-e0fea1a04ccb'} Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:57:50.150426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.151496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.152510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Returning 404 to user: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:57:50.152510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c43480db-8418-4aff-b0fb-779478be0df1 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 404 len: 111 microversion: 2.1 time: 0.034933 Jun 27 14:57:50.152510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 170/334] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:50 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 14:57:50.255683 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:50.256588 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:50.263058 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:50.263781 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:50.264564 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:50.265035 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:50.281571 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.wsgi [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] HTTP exception thrown: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Request method failure captured: Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: request: GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb/os-volume_attachments HTTP/1.1 Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Accept: application/json Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Accept-Encoding: identity Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Connection: close Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Content-Length: 0 Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Content-Type: application/json Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Host: 10.222.0.44 Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Openstack-System-Scope: None Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: User-Agent: python-urllib3/1.26.9 Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Auth-Token: gAAAAABiucT_RaeLb-hnu7iy1tvz34fYh4RZEkiusgjtjRoD0sK38lcwYg9b9_iasImchTa9yaFm8Fxt_fg1ty983r8a964cT6aIHW2Kkq8K9fkt6d2bvLcRE_dVwOocHaiqtQiXbDpheCTuImm-S0OlQYs8FmtM50ksCcQyqdKJxr9LN9Ge8Tg Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Domain-Id: None Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Domain-Name: None Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Identity-Status: Confirmed Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Is-Admin-Project: True Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Project-Domain-Id: default Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Project-Domain-Name: Default Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Project-Id: 27b7c4f8156b409785b5555712cdc934 Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Project-Name: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Role: member,reader Jun 27 14:57:50.284203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Roles: member,reader Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_27b7c4f8156b409785b5555712cdc934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Tenant: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Tenant-Id: 27b7c4f8156b409785b5555712cdc934 Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Tenant-Name: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User: tempest-DeleteServersTestJSON-1083196205-project Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User-Domain-Id: default Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User-Domain-Name: Default Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User-Id: 340af9c8b53a483d9fc311b36736ca01 Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User-Name: tempest-DeleteServersTestJSON-1083196205-project Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: method: > Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: exception: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.286514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: action_args: {'server_id': 'b907368b-2875-4987-b99d-e0fea1a04ccb'} Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:57:50.287191 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:50.288295 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:57:50.289451 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Returning 404 to user: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. {{(pid=129686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:57:50.289451 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-9a8a07fb-26a6-40f0-8eb3-fc71b2f8f26a tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035391 Jun 27 14:57:50.289451 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 165/335] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 14:57:50 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 14:57:50.968979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1313fff9-6331-4daf-b642-888b47c471b3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:50.969582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1313fff9-6331-4daf-b642-888b47c471b3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:50.975702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1313fff9-6331-4daf-b642-888b47c471b3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:50.976141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1313fff9-6331-4daf-b642-888b47c471b3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:50.976910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1313fff9-6331-4daf-b642-888b47c471b3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:50.977336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1313fff9-6331-4daf-b642-888b47c471b3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:51.115634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1313fff9-6331-4daf-b642-888b47c471b3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:51.123245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1313fff9-6331-4daf-b642-888b47c471b3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.158220 Jun 27 14:57:51.123896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 171/336] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:50 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:52.068156 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1208983517", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "networks": [{"uuid": "95c430bf-1406-44be-a0ab-b8b223f20e2e"}]}} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:57:52.140133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0800cf3d-0788-4cf6-a87f-69f91cf79382 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:52.140781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0800cf3d-0788-4cf6-a87f-69f91cf79382 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:52.147168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0800cf3d-0788-4cf6-a87f-69f91cf79382 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:52.147607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0800cf3d-0788-4cf6-a87f-69f91cf79382 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:52.148357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0800cf3d-0788-4cf6-a87f-69f91cf79382 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:52.148944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0800cf3d-0788-4cf6-a87f-69f91cf79382 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:52.280877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0800cf3d-0788-4cf6-a87f-69f91cf79382 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:52.289696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0800cf3d-0788-4cf6-a87f-69f91cf79382 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.153435 Jun 27 14:57:52.291198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 172/337] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:52 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:52.735503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:52.735988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:52.742179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:52.742616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:52.743363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:52.743790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:52.757962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] HTTP exception thrown: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Request method failure captured: Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb HTTP/1.1 Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT_RaeLb-hnu7iy1tvz34fYh4RZEkiusgjtjRoD0sK38lcwYg9b9_iasImchTa9yaFm8Fxt_fg1ty983r8a964cT6aIHW2Kkq8K9fkt6d2bvLcRE_dVwOocHaiqtQiXbDpheCTuImm-S0OlQYs8FmtM50ksCcQyqdKJxr9LN9Ge8Tg Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 27b7c4f8156b409785b5555712cdc934 Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 14:57:52.759422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_27b7c4f8156b409785b5555712cdc934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 27b7c4f8156b409785b5555712cdc934 Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-DeleteServersTestJSON-1083196205-project Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 340af9c8b53a483d9fc311b36736ca01 Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-DeleteServersTestJSON-1083196205-project Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.760908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'b907368b-2875-4987-b99d-e0fea1a04ccb'} Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:57:52.761695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.762795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.763912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Returning 404 to user: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:57:52.763912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9eb64682-6991-4dc2-a6bf-bd1bd88a4bf3 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 404 len: 111 microversion: 2.1 time: 0.029064 Jun 27 14:57:52.763912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 173/338] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 14:57:52 2022] DELETE /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 14:57:52.769431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:52.773567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] [instance: b907368b-2875-4987-b99d-e0fea1a04ccb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:52.775905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:52.776352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:52.777138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:52.777576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:52.792785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] HTTP exception thrown: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Request method failure captured: Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb HTTP/1.1 Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT_RaeLb-hnu7iy1tvz34fYh4RZEkiusgjtjRoD0sK38lcwYg9b9_iasImchTa9yaFm8Fxt_fg1ty983r8a964cT6aIHW2Kkq8K9fkt6d2bvLcRE_dVwOocHaiqtQiXbDpheCTuImm-S0OlQYs8FmtM50ksCcQyqdKJxr9LN9Ge8Tg Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 27b7c4f8156b409785b5555712cdc934 Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 14:57:52.794325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_27b7c4f8156b409785b5555712cdc934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27b7c4f8156b409785b5555712cdc934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 27b7c4f8156b409785b5555712cdc934 Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-DeleteServersTestJSON-1083196205 Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-DeleteServersTestJSON-1083196205-project Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 340af9c8b53a483d9fc311b36736ca01 Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-DeleteServersTestJSON-1083196205-project Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.795864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'b907368b-2875-4987-b99d-e0fea1a04ccb'} Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:57:52.802623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. Jun 27 14:57:52.803815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:57:52.804836 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] Returning 404 to user: Instance b907368b-2875-4987-b99d-e0fea1a04ccb could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:57:52.804836 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9f6efa51-818a-474a-a593-823d617d0cd8 tempest-DeleteServersTestJSON-1083196205 tempest-DeleteServersTestJSON-1083196205-project] 10.222.0.44 "GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb" status: 404 len: 111 microversion: 2.1 time: 0.030482 Jun 27 14:57:52.804836 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 174/339] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:52 2022] GET /compute/v2.1/servers/b907368b-2875-4987-b99d-e0fea1a04ccb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 14:57:53.307449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-02618c59-ca5f-4a73-9924-a00656faa4d8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:53.308165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-02618c59-ca5f-4a73-9924-a00656faa4d8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:53.314647 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02618c59-ca5f-4a73-9924-a00656faa4d8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:53.315098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02618c59-ca5f-4a73-9924-a00656faa4d8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:53.316136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02618c59-ca5f-4a73-9924-a00656faa4d8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:53.316702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02618c59-ca5f-4a73-9924-a00656faa4d8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:53.689261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-02618c59-ca5f-4a73-9924-a00656faa4d8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:53.697082 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-02618c59-ca5f-4a73-9924-a00656faa4d8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.393565 Jun 27 14:57:53.704105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 175/340] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:53 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:54.719537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c18f67d7-2091-4c2f-8f85-cbcb2aa9a42c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:54.720810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c18f67d7-2091-4c2f-8f85-cbcb2aa9a42c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:54.732054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c18f67d7-2091-4c2f-8f85-cbcb2aa9a42c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:54.732495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c18f67d7-2091-4c2f-8f85-cbcb2aa9a42c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:54.738899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c18f67d7-2091-4c2f-8f85-cbcb2aa9a42c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:54.739613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c18f67d7-2091-4c2f-8f85-cbcb2aa9a42c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:54.963289 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c18f67d7-2091-4c2f-8f85-cbcb2aa9a42c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:54.968248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:54.973588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c18f67d7-2091-4c2f-8f85-cbcb2aa9a42c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.258040 Jun 27 14:57:54.984041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 176/341] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:54 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:55.991795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-979f8f23-d303-4508-b958-e8c3a20e27a9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:55.993513 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-979f8f23-d303-4508-b958-e8c3a20e27a9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:56.001505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-979f8f23-d303-4508-b958-e8c3a20e27a9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:56.001951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-979f8f23-d303-4508-b958-e8c3a20e27a9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:56.002724 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-979f8f23-d303-4508-b958-e8c3a20e27a9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:56.003187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-979f8f23-d303-4508-b958-e8c3a20e27a9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:56.197054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-979f8f23-d303-4508-b958-e8c3a20e27a9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:56.208091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-979f8f23-d303-4508-b958-e8c3a20e27a9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.220675 Jun 27 14:57:56.208857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 177/342] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:55 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:57.228044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b8387e11-a482-4e89-b753-d3291caa90b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:57.228736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b8387e11-a482-4e89-b753-d3291caa90b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:57.234606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8387e11-a482-4e89-b753-d3291caa90b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:57.235140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8387e11-a482-4e89-b753-d3291caa90b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:57.235834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8387e11-a482-4e89-b753-d3291caa90b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:57.236262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8387e11-a482-4e89-b753-d3291caa90b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:57.439907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b8387e11-a482-4e89-b753-d3291caa90b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:57.450811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b8387e11-a482-4e89-b753-d3291caa90b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.226407 Jun 27 14:57:57.452534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 178/343] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:57 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:57:58.474045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-235e3c63-8700-4fd5-ab5b-4742e751cf86 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:58.476175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-235e3c63-8700-4fd5-ab5b-4742e751cf86 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:58.486212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-235e3c63-8700-4fd5-ab5b-4742e751cf86 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:58.487055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-235e3c63-8700-4fd5-ab5b-4742e751cf86 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:58.488693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-235e3c63-8700-4fd5-ab5b-4742e751cf86 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:58.489660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-235e3c63-8700-4fd5-ab5b-4742e751cf86 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:58.640449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-235e3c63-8700-4fd5-ab5b-4742e751cf86 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:58.652690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-235e3c63-8700-4fd5-ab5b-4742e751cf86 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.183840 Jun 27 14:57:58.653811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 179/344] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:58 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:57:59.673015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ebf14a31-e62d-470a-8c13-086b9d0954da tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:57:59.673015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ebf14a31-e62d-470a-8c13-086b9d0954da tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:57:59.678663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebf14a31-e62d-470a-8c13-086b9d0954da tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:59.679111 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebf14a31-e62d-470a-8c13-086b9d0954da tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:59.679871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebf14a31-e62d-470a-8c13-086b9d0954da tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:57:59.680297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebf14a31-e62d-470a-8c13-086b9d0954da tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:57:59.804624 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.network.neutron [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] validate_networks() for [('95c430bf-1406-44be-a0ab-b8b223f20e2e', None, None, None, None, None)] {{(pid=129686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:57:59.840026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ebf14a31-e62d-470a-8c13-086b9d0954da tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:57:59.854627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ebf14a31-e62d-470a-8c13-086b9d0954da tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.186705 Jun 27 14:57:59.864802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 180/345] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:57:59 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:00.240937 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Flavor limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:58:00.241992 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Image limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:58:00.242631 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Flavor pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:58:00.243755 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Image pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:58:00.244330 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:58:00.255985 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:00.256481 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:00.259274 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:00.259730 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:00.277134 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Getting quotas for project 0b79598ec54243258d2f2f589be4940d. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:58:00.281187 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Getting quotas for user ef044785763a4bc4be4a1ffd4ea5290f and project 0b79598ec54243258d2f2f589be4940d. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:58:00.294044 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Going to run 1 instances... {{(pid=129686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:58:00.296824 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:58:00.454013 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d82db386-9b77-4725-be77-92ab37dedb85 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.390304 Jun 27 14:58:00.454651 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 166/346] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 8392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 14:58:00.464388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a944a899-b7d6-4f11-9c1a-cc22f7f7a9dc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:00.465012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a944a899-b7d6-4f11-9c1a-cc22f7f7a9dc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:00.526716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a944a899-b7d6-4f11-9c1a-cc22f7f7a9dc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:00.533512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a944a899-b7d6-4f11-9c1a-cc22f7f7a9dc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1214 microversion: 2.1 time: 0.072828 Jun 27 14:58:00.535676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 181/347] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:00 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:00.875184 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-1a2130d0-2046-4238-a54c-f22ca524d587 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:00.878593 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-1a2130d0-2046-4238-a54c-f22ca524d587 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:00.883384 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1a2130d0-2046-4238-a54c-f22ca524d587 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:00.883890 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1a2130d0-2046-4238-a54c-f22ca524d587 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:00.885125 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1a2130d0-2046-4238-a54c-f22ca524d587 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:00.885727 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1a2130d0-2046-4238-a54c-f22ca524d587 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:01.036771 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1a2130d0-2046-4238-a54c-f22ca524d587 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:01.044329 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-1a2130d0-2046-4238-a54c-f22ca524d587 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.174786 Jun 27 14:58:01.044936 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 167/348] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:00 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:01.552437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8da98865-84a5-4cc6-a076-69b53c12fdab tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:01.553062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8da98865-84a5-4cc6-a076-69b53c12fdab tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:01.559024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8da98865-84a5-4cc6-a076-69b53c12fdab tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:01.559498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8da98865-84a5-4cc6-a076-69b53c12fdab tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:01.560253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8da98865-84a5-4cc6-a076-69b53c12fdab tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:01.560717 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8da98865-84a5-4cc6-a076-69b53c12fdab tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:01.630891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8da98865-84a5-4cc6-a076-69b53c12fdab tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:01.648952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8da98865-84a5-4cc6-a076-69b53c12fdab tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1218 microversion: 2.1 time: 0.100751 Jun 27 14:58:01.649539 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 182/349] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:01 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:02.064805 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-1c9c9422-94d0-4095-9a32-13b94d753e4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:02.064805 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-1c9c9422-94d0-4095-9a32-13b94d753e4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:02.070380 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1c9c9422-94d0-4095-9a32-13b94d753e4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:02.070856 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1c9c9422-94d0-4095-9a32-13b94d753e4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:02.071627 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1c9c9422-94d0-4095-9a32-13b94d753e4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:02.072060 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1c9c9422-94d0-4095-9a32-13b94d753e4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:02.219509 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1c9c9422-94d0-4095-9a32-13b94d753e4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:02.227173 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-1c9c9422-94d0-4095-9a32-13b94d753e4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.168390 Jun 27 14:58:02.227737 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 168/350] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:02 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:02.667007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-23ecca1d-46ee-4efb-92da-fec81b6fb134 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:02.667537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-23ecca1d-46ee-4efb-92da-fec81b6fb134 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:02.675941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23ecca1d-46ee-4efb-92da-fec81b6fb134 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:02.676529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23ecca1d-46ee-4efb-92da-fec81b6fb134 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:02.677486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23ecca1d-46ee-4efb-92da-fec81b6fb134 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:02.677926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23ecca1d-46ee-4efb-92da-fec81b6fb134 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:02.747892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-23ecca1d-46ee-4efb-92da-fec81b6fb134 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:02.756478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-23ecca1d-46ee-4efb-92da-fec81b6fb134 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1266 microversion: 2.1 time: 0.093450 Jun 27 14:58:02.764702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 183/351] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:02 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:03.246173 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-0b9dab36-ef1a-4ae7-9342-837b4dd8d3bd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:03.246780 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-0b9dab36-ef1a-4ae7-9342-837b4dd8d3bd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:03.249277 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:03.254593 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0b9dab36-ef1a-4ae7-9342-837b4dd8d3bd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:03.255029 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0b9dab36-ef1a-4ae7-9342-837b4dd8d3bd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:03.255910 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0b9dab36-ef1a-4ae7-9342-837b4dd8d3bd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:03.256344 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-0b9dab36-ef1a-4ae7-9342-837b4dd8d3bd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:03.480339 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-0b9dab36-ef1a-4ae7-9342-837b4dd8d3bd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:03.488289 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-0b9dab36-ef1a-4ae7-9342-837b4dd8d3bd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.248297 Jun 27 14:58:03.488952 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 169/352] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:03 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:03.775221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c323ca74-737c-4e17-9159-ebbe96f7debf tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:03.775828 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c323ca74-737c-4e17-9159-ebbe96f7debf tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:03.782043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c323ca74-737c-4e17-9159-ebbe96f7debf tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:03.782510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c323ca74-737c-4e17-9159-ebbe96f7debf tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:03.783261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c323ca74-737c-4e17-9159-ebbe96f7debf tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:03.784204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c323ca74-737c-4e17-9159-ebbe96f7debf tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:03.950378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c323ca74-737c-4e17-9159-ebbe96f7debf tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:03.957870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c323ca74-737c-4e17-9159-ebbe96f7debf tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.187582 Jun 27 14:58:03.958614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 184/353] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:03 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:04.506410 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9e825d75-9fce-4713-99c9-0154fd96e247 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:04.507548 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-9e825d75-9fce-4713-99c9-0154fd96e247 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:04.514774 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9e825d75-9fce-4713-99c9-0154fd96e247 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:04.515229 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9e825d75-9fce-4713-99c9-0154fd96e247 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:04.516008 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9e825d75-9fce-4713-99c9-0154fd96e247 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:04.516564 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9e825d75-9fce-4713-99c9-0154fd96e247 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:04.725466 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9e825d75-9fce-4713-99c9-0154fd96e247 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:04.733093 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-9e825d75-9fce-4713-99c9-0154fd96e247 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.231335 Jun 27 14:58:04.733754 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 170/354] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:04 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:04.936941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-0ce3d6a6-8bf0-443b-9c79-b46fad9cfd16 req-f2c6b213-fb51-4aae-94bd-822107ede88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "433908cd-dc7d-45e3-bc46-65a48aeaaceb", "tag": "9745de63-b6b9-411c-89f6-62e11c20063b"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:58:04.946752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-0ce3d6a6-8bf0-443b-9c79-b46fad9cfd16 req-f2c6b213-fb51-4aae-94bd-822107ede88b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:04.947208 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-0ce3d6a6-8bf0-443b-9c79-b46fad9cfd16 req-f2c6b213-fb51-4aae-94bd-822107ede88b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:04.961012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-0ce3d6a6-8bf0-443b-9c79-b46fad9cfd16 req-f2c6b213-fb51-4aae-94bd-822107ede88b service nova] Creating event network-changed:9745de63-b6b9-411c-89f6-62e11c20063b for instance 433908cd-dc7d-45e3-bc46-65a48aeaaceb on hv-cinder-79760 Jun 27 14:58:04.966077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-0ce3d6a6-8bf0-443b-9c79-b46fad9cfd16 req-f2c6b213-fb51-4aae-94bd-822107ede88b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032980 Jun 27 14:58:04.966740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 185/355] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:58:04.974946 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-599e6738-963c-4ebd-a6ac-f8eacea7d9e4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:04.975702 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-599e6738-963c-4ebd-a6ac-f8eacea7d9e4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:04.985779 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-599e6738-963c-4ebd-a6ac-f8eacea7d9e4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:04.985779 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-599e6738-963c-4ebd-a6ac-f8eacea7d9e4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:04.985779 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-599e6738-963c-4ebd-a6ac-f8eacea7d9e4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:04.986085 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-599e6738-963c-4ebd-a6ac-f8eacea7d9e4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:05.241106 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-599e6738-963c-4ebd-a6ac-f8eacea7d9e4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:05.252413 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-599e6738-963c-4ebd-a6ac-f8eacea7d9e4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.281131 Jun 27 14:58:05.253695 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 171/356] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:04 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:05.751244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f2c3613f-92e0-4759-a915-4821b39dc568 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:05.751946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f2c3613f-92e0-4759-a915-4821b39dc568 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:05.758837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f2c3613f-92e0-4759-a915-4821b39dc568 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:05.759412 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f2c3613f-92e0-4759-a915-4821b39dc568 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:05.760193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f2c3613f-92e0-4759-a915-4821b39dc568 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:05.760874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f2c3613f-92e0-4759-a915-4821b39dc568 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:05.936462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f2c3613f-92e0-4759-a915-4821b39dc568 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:05.945730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f2c3613f-92e0-4759-a915-4821b39dc568 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.198891 Jun 27 14:58:05.956197 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 186/357] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:05 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:06.270506 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-b3e08812-e945-4172-a21a-792fe9b32a62 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:06.271154 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-b3e08812-e945-4172-a21a-792fe9b32a62 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:06.277892 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b3e08812-e945-4172-a21a-792fe9b32a62 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:06.278339 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b3e08812-e945-4172-a21a-792fe9b32a62 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:06.279096 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b3e08812-e945-4172-a21a-792fe9b32a62 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:06.279528 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b3e08812-e945-4172-a21a-792fe9b32a62 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:06.406395 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-b3e08812-e945-4172-a21a-792fe9b32a62 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:06.414685 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-b3e08812-e945-4172-a21a-792fe9b32a62 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.148386 Jun 27 14:58:06.420513 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 172/358] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:06 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:06.962476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-556348dc-8719-4bc6-9fe6-e6d0b45572ab tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:06.963250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-556348dc-8719-4bc6-9fe6-e6d0b45572ab tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:06.970393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-556348dc-8719-4bc6-9fe6-e6d0b45572ab tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:06.970869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-556348dc-8719-4bc6-9fe6-e6d0b45572ab tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:06.972390 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-556348dc-8719-4bc6-9fe6-e6d0b45572ab tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:06.972943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-556348dc-8719-4bc6-9fe6-e6d0b45572ab tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:07.114437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-556348dc-8719-4bc6-9fe6-e6d0b45572ab tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:07.121894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-556348dc-8719-4bc6-9fe6-e6d0b45572ab tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.163371 Jun 27 14:58:07.122443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 187/359] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:06 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:07.431562 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-1d672d09-80d6-441a-b035-ec3fc5460691 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:07.432164 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-1d672d09-80d6-441a-b035-ec3fc5460691 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:07.438564 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1d672d09-80d6-441a-b035-ec3fc5460691 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:07.439011 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1d672d09-80d6-441a-b035-ec3fc5460691 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:07.440959 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1d672d09-80d6-441a-b035-ec3fc5460691 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:07.441516 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1d672d09-80d6-441a-b035-ec3fc5460691 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:07.573333 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1d672d09-80d6-441a-b035-ec3fc5460691 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:07.580838 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-1d672d09-80d6-441a-b035-ec3fc5460691 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.153123 Jun 27 14:58:07.581548 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 173/360] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:07 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:08.139139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-513a1b29-ccce-4bfc-8acb-d6ad2f247750 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:08.139763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-513a1b29-ccce-4bfc-8acb-d6ad2f247750 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:08.141802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=60 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:08.147075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-513a1b29-ccce-4bfc-8acb-d6ad2f247750 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:08.147514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-513a1b29-ccce-4bfc-8acb-d6ad2f247750 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:08.148293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-513a1b29-ccce-4bfc-8acb-d6ad2f247750 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:08.148749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-513a1b29-ccce-4bfc-8acb-d6ad2f247750 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:08.297466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-513a1b29-ccce-4bfc-8acb-d6ad2f247750 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:08.305329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-513a1b29-ccce-4bfc-8acb-d6ad2f247750 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.170156 Jun 27 14:58:08.305891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 188/361] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:08 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:08.599492 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-bf7a1137-5d88-443d-a908-8228542ab11a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:08.599492 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-bf7a1137-5d88-443d-a908-8228542ab11a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:08.605525 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bf7a1137-5d88-443d-a908-8228542ab11a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:08.605975 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bf7a1137-5d88-443d-a908-8228542ab11a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:08.606729 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bf7a1137-5d88-443d-a908-8228542ab11a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:08.607179 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bf7a1137-5d88-443d-a908-8228542ab11a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:08.733711 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-bf7a1137-5d88-443d-a908-8228542ab11a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:08.741893 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-bf7a1137-5d88-443d-a908-8228542ab11a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.148168 Jun 27 14:58:08.742444 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 174/362] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:08 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:09.324106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ea14f0fd-c678-4732-9ce1-9ce2e763ac90 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:09.325221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ea14f0fd-c678-4732-9ce1-9ce2e763ac90 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:09.332950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea14f0fd-c678-4732-9ce1-9ce2e763ac90 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:09.333510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea14f0fd-c678-4732-9ce1-9ce2e763ac90 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:09.334517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea14f0fd-c678-4732-9ce1-9ce2e763ac90 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:09.335042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea14f0fd-c678-4732-9ce1-9ce2e763ac90 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:09.460142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ea14f0fd-c678-4732-9ce1-9ce2e763ac90 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:09.467605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ea14f0fd-c678-4732-9ce1-9ce2e763ac90 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.148590 Jun 27 14:58:09.468164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 189/363] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:09 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:09.758638 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-3a0327fc-d5b0-4838-940f-71fcc50e3bf4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:09.759241 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-3a0327fc-d5b0-4838-940f-71fcc50e3bf4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:09.765657 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3a0327fc-d5b0-4838-940f-71fcc50e3bf4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:09.766102 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3a0327fc-d5b0-4838-940f-71fcc50e3bf4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:09.766848 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3a0327fc-d5b0-4838-940f-71fcc50e3bf4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:09.767278 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3a0327fc-d5b0-4838-940f-71fcc50e3bf4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:09.892251 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-3a0327fc-d5b0-4838-940f-71fcc50e3bf4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:09.900775 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-3a0327fc-d5b0-4838-940f-71fcc50e3bf4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.145934 Jun 27 14:58:09.901325 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 175/364] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:09 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:10.485005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-68309e26-a52c-4d7a-9f62-58138117b2e4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:10.485636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-68309e26-a52c-4d7a-9f62-58138117b2e4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:10.492466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68309e26-a52c-4d7a-9f62-58138117b2e4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:10.492945 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68309e26-a52c-4d7a-9f62-58138117b2e4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:10.493724 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68309e26-a52c-4d7a-9f62-58138117b2e4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:10.494152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68309e26-a52c-4d7a-9f62-58138117b2e4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:10.533118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:10.624910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-68309e26-a52c-4d7a-9f62-58138117b2e4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:10.632902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-68309e26-a52c-4d7a-9f62-58138117b2e4 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.151891 Jun 27 14:58:10.633462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 190/365] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:10 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:10.918017 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c26a1e45-d524-465f-81d6-9397bce98b29 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:10.918553 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c26a1e45-d524-465f-81d6-9397bce98b29 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:10.920353 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=2 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:10.921018 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=6 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:10.926948 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c26a1e45-d524-465f-81d6-9397bce98b29 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:10.927393 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c26a1e45-d524-465f-81d6-9397bce98b29 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:10.928148 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c26a1e45-d524-465f-81d6-9397bce98b29 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:10.928579 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c26a1e45-d524-465f-81d6-9397bce98b29 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:11.059794 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c26a1e45-d524-465f-81d6-9397bce98b29 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:11.067750 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c26a1e45-d524-465f-81d6-9397bce98b29 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.153596 Jun 27 14:58:11.068320 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 176/366] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:10 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:11.649833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2a6f5fc4-9edb-4b58-ad21-604e45773059 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:11.650444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2a6f5fc4-9edb-4b58-ad21-604e45773059 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:11.656480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a6f5fc4-9edb-4b58-ad21-604e45773059 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:11.656975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a6f5fc4-9edb-4b58-ad21-604e45773059 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:11.657735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a6f5fc4-9edb-4b58-ad21-604e45773059 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:11.658173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a6f5fc4-9edb-4b58-ad21-604e45773059 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:11.784513 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2a6f5fc4-9edb-4b58-ad21-604e45773059 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:11.791866 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2a6f5fc4-9edb-4b58-ad21-604e45773059 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.145965 Jun 27 14:58:11.792424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 191/367] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:11 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:12.084819 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-2032c05b-af2b-434f-9725-083e2a9638bc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:12.085456 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-2032c05b-af2b-434f-9725-083e2a9638bc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:12.091976 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2032c05b-af2b-434f-9725-083e2a9638bc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:12.092414 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2032c05b-af2b-434f-9725-083e2a9638bc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:12.093192 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2032c05b-af2b-434f-9725-083e2a9638bc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:12.093648 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-2032c05b-af2b-434f-9725-083e2a9638bc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:12.224971 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-2032c05b-af2b-434f-9725-083e2a9638bc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:12.232469 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-2032c05b-af2b-434f-9725-083e2a9638bc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.151598 Jun 27 14:58:12.233060 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 177/368] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:12 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:12.808561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-32d83c89-d197-4e81-ac10-f394a8d84cb5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:12.809662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-32d83c89-d197-4e81-ac10-f394a8d84cb5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:12.815635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32d83c89-d197-4e81-ac10-f394a8d84cb5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:12.816083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32d83c89-d197-4e81-ac10-f394a8d84cb5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:12.816871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32d83c89-d197-4e81-ac10-f394a8d84cb5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:12.817302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32d83c89-d197-4e81-ac10-f394a8d84cb5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:12.945912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-32d83c89-d197-4e81-ac10-f394a8d84cb5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:12.953359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-32d83c89-d197-4e81-ac10-f394a8d84cb5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.148566 Jun 27 14:58:12.953919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 192/369] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:12 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:13.255430 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-bbf61d2d-a250-450c-8d15-65245513b565 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:13.256040 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-bbf61d2d-a250-450c-8d15-65245513b565 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:13.262440 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bbf61d2d-a250-450c-8d15-65245513b565 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:13.262879 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bbf61d2d-a250-450c-8d15-65245513b565 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:13.263628 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bbf61d2d-a250-450c-8d15-65245513b565 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:13.264053 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-bbf61d2d-a250-450c-8d15-65245513b565 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:13.393551 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-bbf61d2d-a250-450c-8d15-65245513b565 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:13.400892 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-bbf61d2d-a250-450c-8d15-65245513b565 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.149887 Jun 27 14:58:13.401440 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 178/370] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:13 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:13.969770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-180adae8-ae92-4e3b-b301-463ff3007d4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:13.970366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-180adae8-ae92-4e3b-b301-463ff3007d4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:13.976953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-180adae8-ae92-4e3b-b301-463ff3007d4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:13.977400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-180adae8-ae92-4e3b-b301-463ff3007d4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:13.978148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-180adae8-ae92-4e3b-b301-463ff3007d4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:13.978578 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-180adae8-ae92-4e3b-b301-463ff3007d4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:14.108902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-180adae8-ae92-4e3b-b301-463ff3007d4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:14.116584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-180adae8-ae92-4e3b-b301-463ff3007d4c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.150620 Jun 27 14:58:14.117166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 193/371] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:13 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:14.418014 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4bd0fc5b-b605-4ff4-b04c-e057dc5b4773 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:14.418610 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4bd0fc5b-b605-4ff4-b04c-e057dc5b4773 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:14.425236 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4bd0fc5b-b605-4ff4-b04c-e057dc5b4773 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:14.425681 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4bd0fc5b-b605-4ff4-b04c-e057dc5b4773 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:14.426435 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4bd0fc5b-b605-4ff4-b04c-e057dc5b4773 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:14.426862 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4bd0fc5b-b605-4ff4-b04c-e057dc5b4773 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:14.555521 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4bd0fc5b-b605-4ff4-b04c-e057dc5b4773 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:14.562999 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4bd0fc5b-b605-4ff4-b04c-e057dc5b4773 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.148834 Jun 27 14:58:14.563552 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 179/372] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:14 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:15.133728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-42e2892c-8bbd-41ec-9e2c-28e52a063318 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:15.134333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-42e2892c-8bbd-41ec-9e2c-28e52a063318 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:15.140256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-42e2892c-8bbd-41ec-9e2c-28e52a063318 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:15.140741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-42e2892c-8bbd-41ec-9e2c-28e52a063318 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:15.141486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-42e2892c-8bbd-41ec-9e2c-28e52a063318 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:15.141912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-42e2892c-8bbd-41ec-9e2c-28e52a063318 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:15.267676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-42e2892c-8bbd-41ec-9e2c-28e52a063318 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:15.275015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-42e2892c-8bbd-41ec-9e2c-28e52a063318 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.145110 Jun 27 14:58:15.275571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 194/373] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:15 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:15.580996 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-05307d3b-622d-42e1-8e7b-db2027a01969 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:15.581763 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-05307d3b-622d-42e1-8e7b-db2027a01969 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:15.588073 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-05307d3b-622d-42e1-8e7b-db2027a01969 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:15.588514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-05307d3b-622d-42e1-8e7b-db2027a01969 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:15.589290 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-05307d3b-622d-42e1-8e7b-db2027a01969 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:15.589710 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-05307d3b-622d-42e1-8e7b-db2027a01969 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:15.718391 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-05307d3b-622d-42e1-8e7b-db2027a01969 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:15.726909 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-05307d3b-622d-42e1-8e7b-db2027a01969 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.150306 Jun 27 14:58:15.727475 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 180/374] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:15 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:16.292589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-13577a76-bf28-4d38-8253-4ecb54b5b26d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:16.293215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-13577a76-bf28-4d38-8253-4ecb54b5b26d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:16.299358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13577a76-bf28-4d38-8253-4ecb54b5b26d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:16.299803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13577a76-bf28-4d38-8253-4ecb54b5b26d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:16.300586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13577a76-bf28-4d38-8253-4ecb54b5b26d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:16.301039 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13577a76-bf28-4d38-8253-4ecb54b5b26d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:16.304821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:16.434320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-13577a76-bf28-4d38-8253-4ecb54b5b26d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:16.443175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-13577a76-bf28-4d38-8253-4ecb54b5b26d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.154398 Jun 27 14:58:16.443853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 195/375] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:16 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:16.747813 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-50c207a9-373d-4f2c-97a6-18b833460ee8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:16.748427 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-50c207a9-373d-4f2c-97a6-18b833460ee8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:16.755060 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-50c207a9-373d-4f2c-97a6-18b833460ee8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:16.755504 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-50c207a9-373d-4f2c-97a6-18b833460ee8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:16.756284 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-50c207a9-373d-4f2c-97a6-18b833460ee8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:16.756737 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-50c207a9-373d-4f2c-97a6-18b833460ee8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:16.888292 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-50c207a9-373d-4f2c-97a6-18b833460ee8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:16.895642 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-50c207a9-373d-4f2c-97a6-18b833460ee8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.151685 Jun 27 14:58:16.896204 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 181/376] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:16 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:17.460045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f3484166-6567-4ba1-a862-8f6061584851 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:17.460759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f3484166-6567-4ba1-a862-8f6061584851 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:17.466661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3484166-6567-4ba1-a862-8f6061584851 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:17.467106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3484166-6567-4ba1-a862-8f6061584851 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:17.467861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3484166-6567-4ba1-a862-8f6061584851 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:17.468422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3484166-6567-4ba1-a862-8f6061584851 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:17.596786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f3484166-6567-4ba1-a862-8f6061584851 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:17.604270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f3484166-6567-4ba1-a862-8f6061584851 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.148522 Jun 27 14:58:17.604858 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 196/377] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:17 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:17.911279 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c5050d56-ea63-4e19-845a-7e3331cd6f9c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:17.911987 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c5050d56-ea63-4e19-845a-7e3331cd6f9c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:17.925263 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c5050d56-ea63-4e19-845a-7e3331cd6f9c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:17.925263 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c5050d56-ea63-4e19-845a-7e3331cd6f9c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:17.925263 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c5050d56-ea63-4e19-845a-7e3331cd6f9c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:17.925263 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c5050d56-ea63-4e19-845a-7e3331cd6f9c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:17.926554 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:18.054167 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c5050d56-ea63-4e19-845a-7e3331cd6f9c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:18.061605 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c5050d56-ea63-4e19-845a-7e3331cd6f9c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.154174 Jun 27 14:58:18.062165 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 182/378] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:17 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:18.621335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-49c474b0-573a-462b-951f-2ddd2b35ea50 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:18.621996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-49c474b0-573a-462b-951f-2ddd2b35ea50 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:18.627896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-49c474b0-573a-462b-951f-2ddd2b35ea50 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:18.628340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-49c474b0-573a-462b-951f-2ddd2b35ea50 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:18.629146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-49c474b0-573a-462b-951f-2ddd2b35ea50 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:18.629577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-49c474b0-573a-462b-951f-2ddd2b35ea50 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:18.766560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-49c474b0-573a-462b-951f-2ddd2b35ea50 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:18.776678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-49c474b0-573a-462b-951f-2ddd2b35ea50 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.158815 Jun 27 14:58:18.777517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 197/379] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:18 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:19.079284 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-55237219-2cad-464f-9495-d0b729e8a2d1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:19.079894 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-55237219-2cad-464f-9495-d0b729e8a2d1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:19.087217 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-55237219-2cad-464f-9495-d0b729e8a2d1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:19.087668 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-55237219-2cad-464f-9495-d0b729e8a2d1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:19.088428 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-55237219-2cad-464f-9495-d0b729e8a2d1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:19.088905 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-55237219-2cad-464f-9495-d0b729e8a2d1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:19.261871 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-55237219-2cad-464f-9495-d0b729e8a2d1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:19.270698 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-55237219-2cad-464f-9495-d0b729e8a2d1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.195198 Jun 27 14:58:19.271311 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 183/380] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:19 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:19.796060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-47e37959-988c-4762-bb1a-b038590eed68 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:19.796820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-47e37959-988c-4762-bb1a-b038590eed68 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:19.811588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47e37959-988c-4762-bb1a-b038590eed68 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:19.811588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47e37959-988c-4762-bb1a-b038590eed68 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:19.811588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47e37959-988c-4762-bb1a-b038590eed68 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:19.811588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-47e37959-988c-4762-bb1a-b038590eed68 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:19.945283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-47e37959-988c-4762-bb1a-b038590eed68 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:19.952911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-47e37959-988c-4762-bb1a-b038590eed68 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.161391 Jun 27 14:58:19.953478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 198/381] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:19 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:20.287391 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-af9fc819-afc5-4ef6-a2f3-373d87bc8666 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:20.287908 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-af9fc819-afc5-4ef6-a2f3-373d87bc8666 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:20.294374 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-af9fc819-afc5-4ef6-a2f3-373d87bc8666 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:20.294812 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-af9fc819-afc5-4ef6-a2f3-373d87bc8666 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:20.295607 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-af9fc819-afc5-4ef6-a2f3-373d87bc8666 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:20.296030 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-af9fc819-afc5-4ef6-a2f3-373d87bc8666 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:20.445502 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-af9fc819-afc5-4ef6-a2f3-373d87bc8666 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:20.453781 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-af9fc819-afc5-4ef6-a2f3-373d87bc8666 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.170267 Jun 27 14:58:20.454420 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 184/382] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:20 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:20.970908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-18423465-3fa7-4d84-98ca-dc9a7a8b8b6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:20.972454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-18423465-3fa7-4d84-98ca-dc9a7a8b8b6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:20.982031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18423465-3fa7-4d84-98ca-dc9a7a8b8b6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:20.982031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18423465-3fa7-4d84-98ca-dc9a7a8b8b6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:20.982031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18423465-3fa7-4d84-98ca-dc9a7a8b8b6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:20.982031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18423465-3fa7-4d84-98ca-dc9a7a8b8b6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:21.128074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-18423465-3fa7-4d84-98ca-dc9a7a8b8b6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:21.135535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-18423465-3fa7-4d84-98ca-dc9a7a8b8b6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.168634 Jun 27 14:58:21.136086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 199/383] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:20 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:21.471673 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-68827c7c-444a-4fda-ac28-2031af4f1e5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:21.477456 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-68827c7c-444a-4fda-ac28-2031af4f1e5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:21.484509 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-68827c7c-444a-4fda-ac28-2031af4f1e5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:21.485349 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-68827c7c-444a-4fda-ac28-2031af4f1e5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:21.486169 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-68827c7c-444a-4fda-ac28-2031af4f1e5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:21.487123 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-68827c7c-444a-4fda-ac28-2031af4f1e5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:21.883942 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-68827c7c-444a-4fda-ac28-2031af4f1e5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:21.896829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-68827c7c-444a-4fda-ac28-2031af4f1e5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.425888 Jun 27 14:58:21.896829 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 185/384] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:21 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:22.153464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fda6ca2c-1203-42ea-a5e9-7a67b92489a2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:22.154037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fda6ca2c-1203-42ea-a5e9-7a67b92489a2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:22.160927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fda6ca2c-1203-42ea-a5e9-7a67b92489a2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:22.161434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fda6ca2c-1203-42ea-a5e9-7a67b92489a2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:22.162390 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fda6ca2c-1203-42ea-a5e9-7a67b92489a2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:22.162861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fda6ca2c-1203-42ea-a5e9-7a67b92489a2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:22.342088 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-bfa39810-2e28-46c6-99c5-ed01d26649cd req-17a645b8-5717-437b-87e4-dbaec88d5400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "433908cd-dc7d-45e3-bc46-65a48aeaaceb", "name": "network-vif-plugged", "status": "completed", "tag": "9745de63-b6b9-411c-89f6-62e11c20063b"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:58:22.344291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fda6ca2c-1203-42ea-a5e9-7a67b92489a2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:22.352270 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-bfa39810-2e28-46c6-99c5-ed01d26649cd req-17a645b8-5717-437b-87e4-dbaec88d5400 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:22.352731 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-bfa39810-2e28-46c6-99c5-ed01d26649cd req-17a645b8-5717-437b-87e4-dbaec88d5400 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:22.355069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fda6ca2c-1203-42ea-a5e9-7a67b92489a2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.205459 Jun 27 14:58:22.355912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 200/385] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:22 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:22.364601 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-bfa39810-2e28-46c6-99c5-ed01d26649cd req-17a645b8-5717-437b-87e4-dbaec88d5400 service nova] Creating event network-vif-plugged:9745de63-b6b9-411c-89f6-62e11c20063b for instance 433908cd-dc7d-45e3-bc46-65a48aeaaceb on hv-cinder-79760 Jun 27 14:58:22.369832 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-bfa39810-2e28-46c6-99c5-ed01d26649cd req-17a645b8-5717-437b-87e4-dbaec88d5400 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032012 Jun 27 14:58:22.370478 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 186/386] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:58:22.910045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2b9154c6-5000-401a-9927-e70b3f246644 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:22.910757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2b9154c6-5000-401a-9927-e70b3f246644 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:22.916765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b9154c6-5000-401a-9927-e70b3f246644 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:22.917362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b9154c6-5000-401a-9927-e70b3f246644 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:22.918095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b9154c6-5000-401a-9927-e70b3f246644 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:22.918529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b9154c6-5000-401a-9927-e70b3f246644 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:23.034134 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-826b8102-2d84-4d84-87b6-a783d25db876 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49d6d3ce-de82-4294-a96d-5e0718db76a3", "device": "/dev/sdb"}} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:58:23.036603 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-826b8102-2d84-4d84-87b6-a783d25db876 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:23.045356 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-826b8102-2d84-4d84-87b6-a783d25db876 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:23.046065 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-826b8102-2d84-4d84-87b6-a783d25db876 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:23.047040 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-826b8102-2d84-4d84-87b6-a783d25db876 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:23.048181 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-826b8102-2d84-4d84-87b6-a783d25db876 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:23.070892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2b9154c6-5000-401a-9927-e70b3f246644 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:23.078214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2b9154c6-5000-401a-9927-e70b3f246644 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.172189 Jun 27 14:58:23.078870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 201/387] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:22 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:23.372947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7aaacdd4-edf3-4ab5-881b-c1df530fd44e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:23.373572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7aaacdd4-edf3-4ab5-881b-c1df530fd44e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:23.380597 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7aaacdd4-edf3-4ab5-881b-c1df530fd44e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:23.381077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7aaacdd4-edf3-4ab5-881b-c1df530fd44e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:23.381963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7aaacdd4-edf3-4ab5-881b-c1df530fd44e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:23.382403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7aaacdd4-edf3-4ab5-881b-c1df530fd44e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:23.521364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7aaacdd4-edf3-4ab5-881b-c1df530fd44e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:23.529082 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7aaacdd4-edf3-4ab5-881b-c1df530fd44e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1521 microversion: 2.1 time: 0.160297 Jun 27 14:58:23.540014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 202/388] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:23 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:24.103154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-da8ea2bc-dc4f-4e4e-8e28-e3f715bf3d14 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:24.104138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-da8ea2bc-dc4f-4e4e-8e28-e3f715bf3d14 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:24.117524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-da8ea2bc-dc4f-4e4e-8e28-e3f715bf3d14 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:24.118243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-da8ea2bc-dc4f-4e4e-8e28-e3f715bf3d14 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:24.120451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-da8ea2bc-dc4f-4e4e-8e28-e3f715bf3d14 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:24.121092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-da8ea2bc-dc4f-4e4e-8e28-e3f715bf3d14 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:24.310818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-da8ea2bc-dc4f-4e4e-8e28-e3f715bf3d14 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:24.319338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-da8ea2bc-dc4f-4e4e-8e28-e3f715bf3d14 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.227435 Jun 27 14:58:24.324683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 203/389] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:24 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:24.550430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-dc10678a-7a6e-4e9c-ad93-60c589e08420 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:24.551699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-dc10678a-7a6e-4e9c-ad93-60c589e08420 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:24.562865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dc10678a-7a6e-4e9c-ad93-60c589e08420 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:24.565511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dc10678a-7a6e-4e9c-ad93-60c589e08420 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:24.568325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dc10678a-7a6e-4e9c-ad93-60c589e08420 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:24.569466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dc10678a-7a6e-4e9c-ad93-60c589e08420 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:24.784553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-dc10678a-7a6e-4e9c-ad93-60c589e08420 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:24.797704 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-dc10678a-7a6e-4e9c-ad93-60c589e08420 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1501 microversion: 2.1 time: 0.252086 Jun 27 14:58:24.803300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 204/390] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:24 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:24.829876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ed8ca076-f73f-4169-a44d-3202120dd3c7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:24.837827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ed8ca076-f73f-4169-a44d-3202120dd3c7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:24.860591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ed8ca076-f73f-4169-a44d-3202120dd3c7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:24.862189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ed8ca076-f73f-4169-a44d-3202120dd3c7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:24.865900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ed8ca076-f73f-4169-a44d-3202120dd3c7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:24.867762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ed8ca076-f73f-4169-a44d-3202120dd3c7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:25.038227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ed8ca076-f73f-4169-a44d-3202120dd3c7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:25.046615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ed8ca076-f73f-4169-a44d-3202120dd3c7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1517 microversion: 2.1 time: 0.235515 Jun 27 14:58:25.052679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 205/391] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:24 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:25.336068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-38c94f96-d9aa-4eb5-8bf7-1ba0973d6a08 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:25.336707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-38c94f96-d9aa-4eb5-8bf7-1ba0973d6a08 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:25.348761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-38c94f96-d9aa-4eb5-8bf7-1ba0973d6a08 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:25.349223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-38c94f96-d9aa-4eb5-8bf7-1ba0973d6a08 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:25.350096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-38c94f96-d9aa-4eb5-8bf7-1ba0973d6a08 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:25.351505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-38c94f96-d9aa-4eb5-8bf7-1ba0973d6a08 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:25.512041 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-826b8102-2d84-4d84-87b6-a783d25db876 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "POST /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.482499 Jun 27 14:58:25.523801 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-38c94f96-d9aa-4eb5-8bf7-1ba0973d6a08 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:25.533973 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 187/392] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 14:58:23 2022] POST /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be/os-volume_attachments => generated 194 bytes in 2505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:58:25.535431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-38c94f96-d9aa-4eb5-8bf7-1ba0973d6a08 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1314 microversion: 2.1 time: 0.200408 Jun 27 14:58:25.536308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 206/393] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:25 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:26.552995 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-13730190-f3ef-4173-b549-9def847c5e51 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:26.554487 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-13730190-f3ef-4173-b549-9def847c5e51 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:26.562640 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-13730190-f3ef-4173-b549-9def847c5e51 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:26.563460 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-13730190-f3ef-4173-b549-9def847c5e51 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:26.565259 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-13730190-f3ef-4173-b549-9def847c5e51 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:26.565964 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-13730190-f3ef-4173-b549-9def847c5e51 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:26.795668 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-13730190-f3ef-4173-b549-9def847c5e51 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:26.816393 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-13730190-f3ef-4173-b549-9def847c5e51 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1498 microversion: 2.1 time: 0.267606 Jun 27 14:58:26.818274 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 188/394] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:26 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1498 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:27.496425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-eff27de3-25a0-40e8-9d15-d0e62792163c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:58:27.497437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-eff27de3-25a0-40e8-9d15-d0e62792163c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:27.508978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eff27de3-25a0-40e8-9d15-d0e62792163c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:27.509506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eff27de3-25a0-40e8-9d15-d0e62792163c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:27.510775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eff27de3-25a0-40e8-9d15-d0e62792163c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:27.510971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eff27de3-25a0-40e8-9d15-d0e62792163c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:27.540765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-eff27de3-25a0-40e8-9d15-d0e62792163c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lazy-loading 'flavor' on Instance uuid bbec56f5-672a-4067-8656-c5d152daef90 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:58:27.893462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-eff27de3-25a0-40e8-9d15-d0e62792163c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90/action" status: 200 len: 32 microversion: 2.1 time: 0.402151 Jun 27 14:58:27.894745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 207/395] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 14:58:27 2022] POST /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 14:58:27.903953 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-1fb0960a-0030-49ef-a383-6c49d273a7dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:27.904847 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-1fb0960a-0030-49ef-a383-6c49d273a7dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:27.937962 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1fb0960a-0030-49ef-a383-6c49d273a7dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:27.938706 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1fb0960a-0030-49ef-a383-6c49d273a7dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:27.940878 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1fb0960a-0030-49ef-a383-6c49d273a7dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:27.941552 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1fb0960a-0030-49ef-a383-6c49d273a7dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:28.374066 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1fb0960a-0030-49ef-a383-6c49d273a7dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:28.384760 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-1fb0960a-0030-49ef-a383-6c49d273a7dd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.484618 Jun 27 14:58:28.385640 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 189/396] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:27 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:28.489400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ed9f0b69-4171-4ced-923e-88081c3a4b46 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:28.490011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ed9f0b69-4171-4ced-923e-88081c3a4b46 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:28.497566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ed9f0b69-4171-4ced-923e-88081c3a4b46 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:28.498202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ed9f0b69-4171-4ced-923e-88081c3a4b46 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:28.498783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ed9f0b69-4171-4ced-923e-88081c3a4b46 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:28.499215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ed9f0b69-4171-4ced-923e-88081c3a4b46 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:28.529362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ed9f0b69-4171-4ced-923e-88081c3a4b46 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 14:58:28.576196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:28.930319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ed9f0b69-4171-4ced-923e-88081c3a4b46 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "DELETE /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 204 len: 0 microversion: 2.1 time: 0.448107 Jun 27 14:58:28.932794 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 208/397] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 14:58:28 2022] DELETE /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 14:58:28.941213 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-73054c54-e0f6-4eb7-9cae-ce0f45bbdf44 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:28.941826 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-73054c54-e0f6-4eb7-9cae-ce0f45bbdf44 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:28.950727 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-73054c54-e0f6-4eb7-9cae-ce0f45bbdf44 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:28.951266 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-73054c54-e0f6-4eb7-9cae-ce0f45bbdf44 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:28.952108 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-73054c54-e0f6-4eb7-9cae-ce0f45bbdf44 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:28.952550 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-73054c54-e0f6-4eb7-9cae-ce0f45bbdf44 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:29.113534 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-73054c54-e0f6-4eb7-9cae-ce0f45bbdf44 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:29.121158 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-73054c54-e0f6-4eb7-9cae-ce0f45bbdf44 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1504 microversion: 2.1 time: 0.184599 Jun 27 14:58:29.121737 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 190/398] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:28 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:29.404325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-60bc73f4-4d5e-4ad4-a8f9-819a7a540f77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:29.404977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-60bc73f4-4d5e-4ad4-a8f9-819a7a540f77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:29.415393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60bc73f4-4d5e-4ad4-a8f9-819a7a540f77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:29.415848 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60bc73f4-4d5e-4ad4-a8f9-819a7a540f77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:29.416694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60bc73f4-4d5e-4ad4-a8f9-819a7a540f77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:29.417117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60bc73f4-4d5e-4ad4-a8f9-819a7a540f77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:29.568790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-60bc73f4-4d5e-4ad4-a8f9-819a7a540f77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:29.581027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-60bc73f4-4d5e-4ad4-a8f9-819a7a540f77 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.180718 Jun 27 14:58:29.583501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 209/399] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:29 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:30.138201 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-66b22eb0-a939-452a-8737-4d4ffd3f5c13 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:30.138849 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-66b22eb0-a939-452a-8737-4d4ffd3f5c13 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:30.150915 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-66b22eb0-a939-452a-8737-4d4ffd3f5c13 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:30.151580 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-66b22eb0-a939-452a-8737-4d4ffd3f5c13 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:30.152547 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-66b22eb0-a939-452a-8737-4d4ffd3f5c13 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:30.153084 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-66b22eb0-a939-452a-8737-4d4ffd3f5c13 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:30.338526 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-66b22eb0-a939-452a-8737-4d4ffd3f5c13 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:30.346884 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-66b22eb0-a939-452a-8737-4d4ffd3f5c13 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1504 microversion: 2.1 time: 0.212370 Jun 27 14:58:30.347939 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 191/400] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:30 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:30.602599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ebd81575-5586-460b-bfe9-bd6f828c21dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:30.603358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ebd81575-5586-460b-bfe9-bd6f828c21dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:30.609790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebd81575-5586-460b-bfe9-bd6f828c21dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:30.610333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebd81575-5586-460b-bfe9-bd6f828c21dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:30.611895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebd81575-5586-460b-bfe9-bd6f828c21dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:30.612420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebd81575-5586-460b-bfe9-bd6f828c21dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:30.849399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ebd81575-5586-460b-bfe9-bd6f828c21dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:30.857680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ebd81575-5586-460b-bfe9-bd6f828c21dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.260473 Jun 27 14:58:30.859209 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 210/401] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:30 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:31.363568 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-74c2cd12-9176-4fe5-8bf2-904a32e24604 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:31.364255 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-74c2cd12-9176-4fe5-8bf2-904a32e24604 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:31.375070 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-74c2cd12-9176-4fe5-8bf2-904a32e24604 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:31.382069 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-74c2cd12-9176-4fe5-8bf2-904a32e24604 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:31.382069 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-74c2cd12-9176-4fe5-8bf2-904a32e24604 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:31.382069 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-74c2cd12-9176-4fe5-8bf2-904a32e24604 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:31.753059 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-74c2cd12-9176-4fe5-8bf2-904a32e24604 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:31.765541 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-74c2cd12-9176-4fe5-8bf2-904a32e24604 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1504 microversion: 2.1 time: 0.405910 Jun 27 14:58:31.768675 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 192/402] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:31 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1504 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:31.875477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-45856734-a0b9-4bda-a526-6f88180a89b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:31.876083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-45856734-a0b9-4bda-a526-6f88180a89b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:31.883153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45856734-a0b9-4bda-a526-6f88180a89b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:31.883597 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45856734-a0b9-4bda-a526-6f88180a89b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:31.884349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45856734-a0b9-4bda-a526-6f88180a89b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:31.884802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45856734-a0b9-4bda-a526-6f88180a89b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:32.039260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-45856734-a0b9-4bda-a526-6f88180a89b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:32.056746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-45856734-a0b9-4bda-a526-6f88180a89b5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.184860 Jun 27 14:58:32.057662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 211/403] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:31 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:32.195893 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-e5977308-9dd1-4369-b7e1-a1f323120d1d req-b9e65ae4-ee4e-492e-99de-6bb0004b0231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "433908cd-dc7d-45e3-bc46-65a48aeaaceb", "name": "network-vif-deleted", "tag": "9745de63-b6b9-411c-89f6-62e11c20063b"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:58:32.208066 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-e5977308-9dd1-4369-b7e1-a1f323120d1d req-b9e65ae4-ee4e-492e-99de-6bb0004b0231 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:32.208864 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-e5977308-9dd1-4369-b7e1-a1f323120d1d req-b9e65ae4-ee4e-492e-99de-6bb0004b0231 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:32.221177 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-e5977308-9dd1-4369-b7e1-a1f323120d1d req-b9e65ae4-ee4e-492e-99de-6bb0004b0231 service nova] Creating event network-vif-deleted:9745de63-b6b9-411c-89f6-62e11c20063b for instance 433908cd-dc7d-45e3-bc46-65a48aeaaceb on hv-cinder-79760 Jun 27 14:58:32.226755 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-e5977308-9dd1-4369-b7e1-a1f323120d1d req-b9e65ae4-ee4e-492e-99de-6bb0004b0231 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034429 Jun 27 14:58:32.229815 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 193/404] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:58:32.786130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:32.786792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:32.804207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:32.804497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:32.805302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:32.805912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:32.851335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:32.851797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:32.852298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lazy-loading 'fault' on Instance uuid 433908cd-dc7d-45e3-bc46-65a48aeaaceb {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:58:32.903809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:32.913196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ab84a96d-b766-4a86-a0e7-428ba93a84a8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 200 len: 1304 microversion: 2.1 time: 0.131541 Jun 27 14:58:32.913920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 212/405] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:32 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:33.076252 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-79cbb4fb-8c4f-4383-9556-d2fb3a8c2089 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:33.076979 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-79cbb4fb-8c4f-4383-9556-d2fb3a8c2089 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:33.085174 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-79cbb4fb-8c4f-4383-9556-d2fb3a8c2089 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:33.085711 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-79cbb4fb-8c4f-4383-9556-d2fb3a8c2089 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:33.086740 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-79cbb4fb-8c4f-4383-9556-d2fb3a8c2089 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:33.087172 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-79cbb4fb-8c4f-4383-9556-d2fb3a8c2089 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:33.498098 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-79cbb4fb-8c4f-4383-9556-d2fb3a8c2089 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:33.507614 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-79cbb4fb-8c4f-4383-9556-d2fb3a8c2089 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.435174 Jun 27 14:58:33.507842 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 194/406] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:33 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:33.930742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:33.931340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 433908cd-dc7d-45e3-bc46-65a48aeaaceb] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:33.937233 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:33.937674 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:33.938424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:33.939206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:33.958658 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] HTTP exception thrown: Instance 433908cd-dc7d-45e3-bc46-65a48aeaaceb could not be found. Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Request method failure captured: Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb HTTP/1.1 Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucVsELryjrzMfX5Of6K7QuX0UTQY3dbCL6UrSAFwHfA81gvi4Ah9AeusVlUEDH6ouUqF3mTvEJU9xpSnHL4xPJ7JQRPkDw8_0uNg4d941z0ZVNJsgKYmpyTTOAeqaDCTwmGvTD9BNBinZ3I1XzD8dZYM6YgoPy8ZL7Fp8bO18dYIKsU Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 0b79598ec54243258d2f2f589be4940d Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesActionsTest-1428158574 Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 14:58:33.960348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0b79598ec54243258d2f2f589be4940d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0b79598ec54243258d2f2f589be4940d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0b79598ec54243258d2f2f589be4940d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0b79598ec54243258d2f2f589be4940d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesActionsTest-1428158574 Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 0b79598ec54243258d2f2f589be4940d Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesActionsTest-1428158574 Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesActionsTest-1428158574-project Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: ef044785763a4bc4be4a1ffd4ea5290f Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesActionsTest-1428158574-project Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 433908cd-dc7d-45e3-bc46-65a48aeaaceb could not be found. Jun 27 14:58:33.961927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '433908cd-dc7d-45e3-bc46-65a48aeaaceb'} Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 433908cd-dc7d-45e3-bc46-65a48aeaaceb could not be found. Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:58:33.962672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 433908cd-dc7d-45e3-bc46-65a48aeaaceb could not be found. Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 433908cd-dc7d-45e3-bc46-65a48aeaaceb could not be found. Jun 27 14:58:33.963854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:58:33.964919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Returning 404 to user: Instance 433908cd-dc7d-45e3-bc46-65a48aeaaceb could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:58:33.964919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f120b69c-50d9-461c-97eb-d8cc4f480402 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb" status: 404 len: 111 microversion: 2.1 time: 0.034984 Jun 27 14:58:33.964919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 213/407] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:33 2022] GET /compute/v2.1/servers/433908cd-dc7d-45e3-bc46-65a48aeaaceb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 14:58:34.102593 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1319162282", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "networks": [{"uuid": "95c430bf-1406-44be-a0ab-b8b223f20e2e"}]}} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:58:34.198721 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.network.neutron [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] validate_networks() for [('95c430bf-1406-44be-a0ab-b8b223f20e2e', None, None, None, None, None)] {{(pid=129686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:58:34.532034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-62ce8371-48ed-428d-9478-d38e2351c12d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:34.532617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-62ce8371-48ed-428d-9478-d38e2351c12d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:34.556415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62ce8371-48ed-428d-9478-d38e2351c12d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:34.557900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62ce8371-48ed-428d-9478-d38e2351c12d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:34.559682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62ce8371-48ed-428d-9478-d38e2351c12d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:34.560815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62ce8371-48ed-428d-9478-d38e2351c12d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:34.750283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-62ce8371-48ed-428d-9478-d38e2351c12d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:34.766814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-62ce8371-48ed-428d-9478-d38e2351c12d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.244388 Jun 27 14:58:34.779352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 214/408] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:34 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:35.000913 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Flavor limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:58:35.001335 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Image limits 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:58:35.002914 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Flavor pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:58:35.003514 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Image pref 0:0:0 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:58:35.004041 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.virt.hardware [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:58:35.014018 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:35.014463 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:35.015512 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:35.015927 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:35.034318 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Getting quotas for project 0b79598ec54243258d2f2f589be4940d. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:58:35.039873 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.quota [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Getting quotas for user ef044785763a4bc4be4a1ffd4ea5290f and project 0b79598ec54243258d2f2f589be4940d. Resources: {'instances', 'ram', 'cores'} {{(pid=129686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:58:35.051697 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Going to run 1 instances... {{(pid=129686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:58:35.054256 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:58:35.201473 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-80bb7715-f447-428b-ade6-b04995b77b11 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112428 Jun 27 14:58:35.208464 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 195/409] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 14:58:35.213146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-47e853fd-c02d-450e-9c98-3dcc2ea61f18 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:35.214678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-47e853fd-c02d-450e-9c98-3dcc2ea61f18 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:35.306634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-47e853fd-c02d-450e-9c98-3dcc2ea61f18 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:35.318331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-47e853fd-c02d-450e-9c98-3dcc2ea61f18 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1214 microversion: 2.1 time: 0.108922 Jun 27 14:58:35.319221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 215/410] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:35 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:35.797940 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-096aa56e-fbb0-4159-9094-cee27c45fc48 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:35.799213 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-096aa56e-fbb0-4159-9094-cee27c45fc48 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:35.808403 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-096aa56e-fbb0-4159-9094-cee27c45fc48 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:35.809216 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-096aa56e-fbb0-4159-9094-cee27c45fc48 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:35.810904 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-096aa56e-fbb0-4159-9094-cee27c45fc48 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:35.811586 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-096aa56e-fbb0-4159-9094-cee27c45fc48 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:36.068415 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-096aa56e-fbb0-4159-9094-cee27c45fc48 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:36.074907 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-096aa56e-fbb0-4159-9094-cee27c45fc48 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.284177 Jun 27 14:58:36.075690 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 196/411] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:35 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:36.340904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4c35ff04-afb4-4888-81ad-0dd6ea285358 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:36.341586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4c35ff04-afb4-4888-81ad-0dd6ea285358 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:36.350591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c35ff04-afb4-4888-81ad-0dd6ea285358 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:36.351777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c35ff04-afb4-4888-81ad-0dd6ea285358 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:36.351991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c35ff04-afb4-4888-81ad-0dd6ea285358 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:36.352658 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c35ff04-afb4-4888-81ad-0dd6ea285358 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:36.437946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4c35ff04-afb4-4888-81ad-0dd6ea285358 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:36.447939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4c35ff04-afb4-4888-81ad-0dd6ea285358 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1218 microversion: 2.1 time: 0.111161 Jun 27 14:58:36.448540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 216/412] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:36 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:37.096709 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-20cb7316-3b8d-47a1-b264-ac533c52fb78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:37.098095 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-20cb7316-3b8d-47a1-b264-ac533c52fb78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:37.105564 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:37.111060 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-20cb7316-3b8d-47a1-b264-ac533c52fb78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:37.111060 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-20cb7316-3b8d-47a1-b264-ac533c52fb78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:37.111060 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-20cb7316-3b8d-47a1-b264-ac533c52fb78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:37.111060 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-20cb7316-3b8d-47a1-b264-ac533c52fb78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:37.255818 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-20cb7316-3b8d-47a1-b264-ac533c52fb78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:37.264700 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-20cb7316-3b8d-47a1-b264-ac533c52fb78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.175826 Jun 27 14:58:37.265853 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 197/413] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:37 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:37.404030 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-452d70c9-07fc-4178-bbe8-d5e6e0580217 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Action: 'create', calling method: .version_select at 0x7f13f9cb5ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-171805540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCPxuv4wvpWaqQWU6mLJAgeJRMmwsTS8TT58bTK7edmihnxd4VgpgfxqZdh9ASlhcDOUluyNLOaahU8BDYphj7p2qz0Bi5B3hVBtcCBf7DgtZEYgK8bXXjK+mev6v8iEQ=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:58:37.418629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-452d70c9-07fc-4178-bbe8-d5e6e0580217 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Getting quotas for project 253d5ed8735d445c930140b6d91136c8. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:58:37.422728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-452d70c9-07fc-4178-bbe8-d5e6e0580217 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Getting quotas for user 4f764a725deb405198f95d583035b371 and project 253d5ed8735d445c930140b6d91136c8. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:58:37.464894 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-db13503d-7209-4988-a91f-d975468ca5c1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:37.465497 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-db13503d-7209-4988-a91f-d975468ca5c1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:37.472481 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-db13503d-7209-4988-a91f-d975468ca5c1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:37.473084 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-db13503d-7209-4988-a91f-d975468ca5c1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:37.473835 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-db13503d-7209-4988-a91f-d975468ca5c1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:37.474474 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-db13503d-7209-4988-a91f-d975468ca5c1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:37.529326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-452d70c9-07fc-4178-bbe8-d5e6e0580217 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.432685 Jun 27 14:58:37.530109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 217/414] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 14:58:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:58:37.553142 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-db13503d-7209-4988-a91f-d975468ca5c1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:37.575446 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-db13503d-7209-4988-a91f-d975468ca5c1 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1210 microversion: 2.1 time: 0.114427 Jun 27 14:58:37.580376 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 198/415] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:37 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:38.283861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e2f36bef-4961-49d1-ab8d-5d91e405b714 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:38.284721 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e2f36bef-4961-49d1-ab8d-5d91e405b714 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:38.286975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:38.292553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2f36bef-4961-49d1-ab8d-5d91e405b714 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:38.293045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2f36bef-4961-49d1-ab8d-5d91e405b714 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:38.293949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2f36bef-4961-49d1-ab8d-5d91e405b714 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:38.294382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2f36bef-4961-49d1-ab8d-5d91e405b714 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:38.439974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e2f36bef-4961-49d1-ab8d-5d91e405b714 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:38.450973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e2f36bef-4961-49d1-ab8d-5d91e405b714 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.171434 Jun 27 14:58:38.451548 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 218/416] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:38 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:38.594384 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4f079de5-1f38-494b-98f2-ca4050630705 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:38.594992 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4f079de5-1f38-494b-98f2-ca4050630705 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:38.602129 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f079de5-1f38-494b-98f2-ca4050630705 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:38.602570 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f079de5-1f38-494b-98f2-ca4050630705 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:38.603348 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f079de5-1f38-494b-98f2-ca4050630705 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:38.603988 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f079de5-1f38-494b-98f2-ca4050630705 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:38.624737 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:38.673772 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4f079de5-1f38-494b-98f2-ca4050630705 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:38.683493 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4f079de5-1f38-494b-98f2-ca4050630705 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1210 microversion: 2.1 time: 0.092773 Jun 27 14:58:38.684177 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 199/417] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:38 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:39.477852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-187a9bd0-ab6f-4872-ab90-8be21c3a5343 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:39.477852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-187a9bd0-ab6f-4872-ab90-8be21c3a5343 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:39.482244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-187a9bd0-ab6f-4872-ab90-8be21c3a5343 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:39.482997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-187a9bd0-ab6f-4872-ab90-8be21c3a5343 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:39.484078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-187a9bd0-ab6f-4872-ab90-8be21c3a5343 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:39.484784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-187a9bd0-ab6f-4872-ab90-8be21c3a5343 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:39.702159 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-7c408743-417a-4278-b2d5-faa7171f1915 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:39.703407 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-7c408743-417a-4278-b2d5-faa7171f1915 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:39.713862 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7c408743-417a-4278-b2d5-faa7171f1915 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:39.716001 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7c408743-417a-4278-b2d5-faa7171f1915 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:39.717256 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7c408743-417a-4278-b2d5-faa7171f1915 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:39.717859 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-7c408743-417a-4278-b2d5-faa7171f1915 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:39.723623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-187a9bd0-ab6f-4872-ab90-8be21c3a5343 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:39.737951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-187a9bd0-ab6f-4872-ab90-8be21c3a5343 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.270035 Jun 27 14:58:39.738551 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 219/418] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:39 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:39.808626 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-7c408743-417a-4278-b2d5-faa7171f1915 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:39.817504 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-7c408743-417a-4278-b2d5-faa7171f1915 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1210 microversion: 2.1 time: 0.119675 Jun 27 14:58:39.826731 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 200/419] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:39 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:40.760768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c6db5605-164a-4216-80ef-ea21002ad3f8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:40.762046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c6db5605-164a-4216-80ef-ea21002ad3f8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:40.772313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6db5605-164a-4216-80ef-ea21002ad3f8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:40.773016 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6db5605-164a-4216-80ef-ea21002ad3f8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:40.773803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6db5605-164a-4216-80ef-ea21002ad3f8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:40.774237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6db5605-164a-4216-80ef-ea21002ad3f8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:40.836612 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4848c7bf-03a8-4037-b38a-b93dd6f35573 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:40.837429 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4848c7bf-03a8-4037-b38a-b93dd6f35573 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:40.849681 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4848c7bf-03a8-4037-b38a-b93dd6f35573 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:40.853017 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4848c7bf-03a8-4037-b38a-b93dd6f35573 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:40.853971 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4848c7bf-03a8-4037-b38a-b93dd6f35573 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:40.854521 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4848c7bf-03a8-4037-b38a-b93dd6f35573 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:40.934727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c6db5605-164a-4216-80ef-ea21002ad3f8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:40.947202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c6db5605-164a-4216-80ef-ea21002ad3f8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.192419 Jun 27 14:58:40.950195 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 220/420] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:40 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:40.956023 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4848c7bf-03a8-4037-b38a-b93dd6f35573 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:40.964534 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4848c7bf-03a8-4037-b38a-b93dd6f35573 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1266 microversion: 2.1 time: 0.131803 Jun 27 14:58:40.965524 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 201/421] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:40 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:41.875450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-291982102", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:58:41.926520 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] validate_networks() for None {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:58:41.967668 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-f3ca51a5-a1ee-4060-98cd-911ed370727b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:41.968266 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-f3ca51a5-a1ee-4060-98cd-911ed370727b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:41.976736 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f3ca51a5-a1ee-4060-98cd-911ed370727b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:41.976736 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f3ca51a5-a1ee-4060-98cd-911ed370727b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:41.977199 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f3ca51a5-a1ee-4060-98cd-911ed370727b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:41.977634 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-f3ca51a5-a1ee-4060-98cd-911ed370727b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:42.185636 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-f3ca51a5-a1ee-4060-98cd-911ed370727b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:42.195873 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-f3ca51a5-a1ee-4060-98cd-911ed370727b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.232191 Jun 27 14:58:42.208547 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 202/422] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:41 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:42.215733 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-45eba497-5eaa-476c-8ce3-3576286e811b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:42.217646 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-45eba497-5eaa-476c-8ce3-3576286e811b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:42.230461 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-45eba497-5eaa-476c-8ce3-3576286e811b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:42.230916 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-45eba497-5eaa-476c-8ce3-3576286e811b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:42.231691 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-45eba497-5eaa-476c-8ce3-3576286e811b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:42.232124 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-45eba497-5eaa-476c-8ce3-3576286e811b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:42.236141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:58:42.237096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:58:42.237974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:58:42.238486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:58:42.238944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:58:42.249761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:42.250240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:42.251053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:42.251999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:42.270353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Getting quotas for project 773c5d27e2b24590922802937bf9db1b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:58:42.274991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Getting quotas for user c150fadafc3944159dfbf11f15bb1ba5 and project 773c5d27e2b24590922802937bf9db1b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:58:42.286929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:58:42.289189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:58:42.317257 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-45eba497-5eaa-476c-8ce3-3576286e811b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:42.325258 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-45eba497-5eaa-476c-8ce3-3576286e811b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1272 microversion: 2.1 time: 0.115428 Jun 27 14:58:42.325822 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 203/423] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:42 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:42.378337 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-61fe5e1c-a515-4a34-b3e4-117424103e04 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506668 Jun 27 14:58:42.379086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 221/424] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 14:58:42.390654 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-fdeb6595-65a6-416a-93e9-20df465467a5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:42.392584 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-fdeb6595-65a6-416a-93e9-20df465467a5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:42.475107 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fdeb6595-65a6-416a-93e9-20df465467a5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:42.491259 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-fdeb6595-65a6-416a-93e9-20df465467a5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1214 microversion: 2.1 time: 0.106124 Jun 27 14:58:42.491993 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 204/425] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:42 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:43.214334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d800b011-23d6-45eb-ba3d-9a5777eedb21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:43.214902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d800b011-23d6-45eb-ba3d-9a5777eedb21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:43.221397 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d800b011-23d6-45eb-ba3d-9a5777eedb21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:43.221842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d800b011-23d6-45eb-ba3d-9a5777eedb21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:43.222606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d800b011-23d6-45eb-ba3d-9a5777eedb21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:43.223040 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d800b011-23d6-45eb-ba3d-9a5777eedb21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:43.341494 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c29702e4-69d3-459c-b09c-3a5334d7a818 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:43.342162 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c29702e4-69d3-459c-b09c-3a5334d7a818 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:43.351453 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c29702e4-69d3-459c-b09c-3a5334d7a818 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:43.351897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c29702e4-69d3-459c-b09c-3a5334d7a818 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:43.352771 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c29702e4-69d3-459c-b09c-3a5334d7a818 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:43.353098 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c29702e4-69d3-459c-b09c-3a5334d7a818 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:43.355445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d800b011-23d6-45eb-ba3d-9a5777eedb21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:43.363466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d800b011-23d6-45eb-ba3d-9a5777eedb21 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.153056 Jun 27 14:58:43.364025 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 222/426] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:43 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:43.483388 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c29702e4-69d3-459c-b09c-3a5334d7a818 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:43.491879 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c29702e4-69d3-459c-b09c-3a5334d7a818 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.154238 Jun 27 14:58:43.492451 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 205/427] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:43 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:43.507843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4cc9a2bb-a9f5-4799-93e4-e90d618951ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:43.508443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4cc9a2bb-a9f5-4799-93e4-e90d618951ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:43.514367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4cc9a2bb-a9f5-4799-93e4-e90d618951ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:43.514804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4cc9a2bb-a9f5-4799-93e4-e90d618951ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:43.515692 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4cc9a2bb-a9f5-4799-93e4-e90d618951ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:43.516009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4cc9a2bb-a9f5-4799-93e4-e90d618951ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:43.576335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4cc9a2bb-a9f5-4799-93e4-e90d618951ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:43.584062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4cc9a2bb-a9f5-4799-93e4-e90d618951ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1218 microversion: 2.1 time: 0.080026 Jun 27 14:58:43.585103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 223/428] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:43 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:44.380664 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9284dda4-35e9-44fa-aa89-b43dd6623861 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:44.381281 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-9284dda4-35e9-44fa-aa89-b43dd6623861 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:44.387704 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9284dda4-35e9-44fa-aa89-b43dd6623861 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:44.388154 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9284dda4-35e9-44fa-aa89-b43dd6623861 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:44.388940 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9284dda4-35e9-44fa-aa89-b43dd6623861 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:44.389379 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9284dda4-35e9-44fa-aa89-b43dd6623861 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:44.508703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8b4eae24-d963-4007-97a6-1cad69d5a8b6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:44.509340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8b4eae24-d963-4007-97a6-1cad69d5a8b6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:44.515622 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b4eae24-d963-4007-97a6-1cad69d5a8b6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:44.516069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b4eae24-d963-4007-97a6-1cad69d5a8b6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:44.517217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b4eae24-d963-4007-97a6-1cad69d5a8b6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:44.517340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b4eae24-d963-4007-97a6-1cad69d5a8b6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:44.530931 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9284dda4-35e9-44fa-aa89-b43dd6623861 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:44.542897 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-9284dda4-35e9-44fa-aa89-b43dd6623861 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.166644 Jun 27 14:58:44.545922 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 206/429] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:44 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:44.601692 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-980a7d78-7d24-4e1a-8d12-bae97c816a86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:44.603212 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-980a7d78-7d24-4e1a-8d12-bae97c816a86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:44.611592 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-980a7d78-7d24-4e1a-8d12-bae97c816a86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:44.612177 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-980a7d78-7d24-4e1a-8d12-bae97c816a86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:44.613046 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-980a7d78-7d24-4e1a-8d12-bae97c816a86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:44.613545 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-980a7d78-7d24-4e1a-8d12-bae97c816a86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:44.685006 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8b4eae24-d963-4007-97a6-1cad69d5a8b6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:44.693073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8b4eae24-d963-4007-97a6-1cad69d5a8b6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.188185 Jun 27 14:58:44.696700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 224/430] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:44 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:44.701992 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-980a7d78-7d24-4e1a-8d12-bae97c816a86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:44.709591 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-980a7d78-7d24-4e1a-8d12-bae97c816a86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1218 microversion: 2.1 time: 0.111876 Jun 27 14:58:44.710336 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 207/431] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:44 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:45.562393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2c23af7b-bfac-497e-b023-f50450be97b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:45.563050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2c23af7b-bfac-497e-b023-f50450be97b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:45.570491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2c23af7b-bfac-497e-b023-f50450be97b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:45.570930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2c23af7b-bfac-497e-b023-f50450be97b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:45.571835 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2c23af7b-bfac-497e-b023-f50450be97b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:45.572262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2c23af7b-bfac-497e-b023-f50450be97b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:45.706052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2c23af7b-bfac-497e-b023-f50450be97b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:45.711458 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-082bb84f-e9c1-4a41-9140-63428b2a0072 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:45.712170 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-082bb84f-e9c1-4a41-9140-63428b2a0072 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:45.714157 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=2 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:45.717449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2c23af7b-bfac-497e-b023-f50450be97b7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.159024 Jun 27 14:58:45.718144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 225/432] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:45 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:45.721015 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-082bb84f-e9c1-4a41-9140-63428b2a0072 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:45.721836 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-082bb84f-e9c1-4a41-9140-63428b2a0072 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:45.722713 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-082bb84f-e9c1-4a41-9140-63428b2a0072 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:45.723187 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-082bb84f-e9c1-4a41-9140-63428b2a0072 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:45.727057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4c49d73b-b59c-4369-a7f2-2585b7acedbb tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:45.727668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4c49d73b-b59c-4369-a7f2-2585b7acedbb tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:45.733519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c49d73b-b59c-4369-a7f2-2585b7acedbb tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:45.733956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c49d73b-b59c-4369-a7f2-2585b7acedbb tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:45.734701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c49d73b-b59c-4369-a7f2-2585b7acedbb tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:45.735128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c49d73b-b59c-4369-a7f2-2585b7acedbb tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:45.795675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4c49d73b-b59c-4369-a7f2-2585b7acedbb tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:45.804564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4c49d73b-b59c-4369-a7f2-2585b7acedbb tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1218 microversion: 2.1 time: 0.080929 Jun 27 14:58:45.805405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 226/433] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:45 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:45.861084 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-082bb84f-e9c1-4a41-9140-63428b2a0072 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:45.870648 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-082bb84f-e9c1-4a41-9140-63428b2a0072 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.164330 Jun 27 14:58:45.871228 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 208/434] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:45 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:46.734465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7098ed5e-aa9f-4125-8547-88c00ba2ceed tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:46.735069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7098ed5e-aa9f-4125-8547-88c00ba2ceed tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:46.741832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7098ed5e-aa9f-4125-8547-88c00ba2ceed tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:46.742282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7098ed5e-aa9f-4125-8547-88c00ba2ceed tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:46.743028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7098ed5e-aa9f-4125-8547-88c00ba2ceed tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:46.743458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7098ed5e-aa9f-4125-8547-88c00ba2ceed tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:46.822526 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-e8db7928-4b7e-4a6c-a402-e48c11c22443 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:46.823073 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-e8db7928-4b7e-4a6c-a402-e48c11c22443 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:46.829574 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e8db7928-4b7e-4a6c-a402-e48c11c22443 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:46.830121 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e8db7928-4b7e-4a6c-a402-e48c11c22443 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:46.830919 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e8db7928-4b7e-4a6c-a402-e48c11c22443 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:46.831351 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-e8db7928-4b7e-4a6c-a402-e48c11c22443 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:46.874704 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7098ed5e-aa9f-4125-8547-88c00ba2ceed tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:46.878282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:46.882911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7098ed5e-aa9f-4125-8547-88c00ba2ceed tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.152201 Jun 27 14:58:46.883865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 227/435] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:46 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:46.888237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-40703019-f94c-4eec-98fc-5bf33f1d4024 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:46.888864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-40703019-f94c-4eec-98fc-5bf33f1d4024 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:46.894857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40703019-f94c-4eec-98fc-5bf33f1d4024 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:46.895293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40703019-f94c-4eec-98fc-5bf33f1d4024 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:46.896042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40703019-f94c-4eec-98fc-5bf33f1d4024 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:46.896464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40703019-f94c-4eec-98fc-5bf33f1d4024 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:46.911164 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-e8db7928-4b7e-4a6c-a402-e48c11c22443 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:46.918969 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-e8db7928-4b7e-4a6c-a402-e48c11c22443 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1218 microversion: 2.1 time: 0.101224 Jun 27 14:58:46.919871 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 209/436] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:46 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:47.036534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-40703019-f94c-4eec-98fc-5bf33f1d4024 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:47.043909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-40703019-f94c-4eec-98fc-5bf33f1d4024 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.159302 Jun 27 14:58:47.044475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 228/437] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:46 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:47.904118 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-fdb76b45-8e42-46eb-911a-a95a7fdae998 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:47.904758 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-fdb76b45-8e42-46eb-911a-a95a7fdae998 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:47.911400 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fdb76b45-8e42-46eb-911a-a95a7fdae998 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:47.911853 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fdb76b45-8e42-46eb-911a-a95a7fdae998 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:47.912613 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fdb76b45-8e42-46eb-911a-a95a7fdae998 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:47.913080 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fdb76b45-8e42-46eb-911a-a95a7fdae998 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:47.937404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a402bb5d-a0f4-40db-a046-88fa3af3d2ca tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:47.938903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a402bb5d-a0f4-40db-a046-88fa3af3d2ca tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:47.947305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a402bb5d-a0f4-40db-a046-88fa3af3d2ca tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:47.947871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a402bb5d-a0f4-40db-a046-88fa3af3d2ca tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:47.948630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a402bb5d-a0f4-40db-a046-88fa3af3d2ca tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:47.949078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a402bb5d-a0f4-40db-a046-88fa3af3d2ca tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:48.030798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a402bb5d-a0f4-40db-a046-88fa3af3d2ca tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:48.041411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a402bb5d-a0f4-40db-a046-88fa3af3d2ca tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1218 microversion: 2.1 time: 0.108334 Jun 27 14:58:48.043375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 229/438] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:47 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:48.062112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-05136483-ba9b-4eb4-91b0-408f70c6bd0b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:48.062732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-05136483-ba9b-4eb4-91b0-408f70c6bd0b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:48.071260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05136483-ba9b-4eb4-91b0-408f70c6bd0b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:48.071753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05136483-ba9b-4eb4-91b0-408f70c6bd0b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:48.072578 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05136483-ba9b-4eb4-91b0-408f70c6bd0b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:48.073054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05136483-ba9b-4eb4-91b0-408f70c6bd0b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:48.198781 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fdb76b45-8e42-46eb-911a-a95a7fdae998 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:48.209306 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-fdb76b45-8e42-46eb-911a-a95a7fdae998 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.308762 Jun 27 14:58:48.209898 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 210/439] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:47 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:48.249103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-05136483-ba9b-4eb4-91b0-408f70c6bd0b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:48.259455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-05136483-ba9b-4eb4-91b0-408f70c6bd0b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.199542 Jun 27 14:58:48.260309 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 230/440] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:48 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:49.059154 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-adf2eb48-f324-4c28-8102-febbbe4d6884 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:49.059753 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-adf2eb48-f324-4c28-8102-febbbe4d6884 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:49.066690 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-adf2eb48-f324-4c28-8102-febbbe4d6884 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:49.067303 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-adf2eb48-f324-4c28-8102-febbbe4d6884 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:49.067866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-adf2eb48-f324-4c28-8102-febbbe4d6884 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:49.068296 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-adf2eb48-f324-4c28-8102-febbbe4d6884 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:49.193364 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-adf2eb48-f324-4c28-8102-febbbe4d6884 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:49.200975 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-adf2eb48-f324-4c28-8102-febbbe4d6884 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1266 microversion: 2.1 time: 0.145463 Jun 27 14:58:49.202421 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 211/441] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:49 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:49.212472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-1776881e-2eab-4255-a366-bd32d5463891 req-2c2f1189-ed90-4b48-8843-3e5ed90535d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094071af-88ab-4d0b-b351-11aa81077ebd", "tag": "1c3fdae4-f9aa-4a9b-9036-d0ab24130b54"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:58:49.227164 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-26ec0180-6939-400c-82ed-ac6f7359e101 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:49.227908 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-26ec0180-6939-400c-82ed-ac6f7359e101 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:49.235266 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-26ec0180-6939-400c-82ed-ac6f7359e101 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:49.236400 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-26ec0180-6939-400c-82ed-ac6f7359e101 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:49.241625 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-26ec0180-6939-400c-82ed-ac6f7359e101 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:49.241625 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-26ec0180-6939-400c-82ed-ac6f7359e101 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:49.241892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-1776881e-2eab-4255-a366-bd32d5463891 req-2c2f1189-ed90-4b48-8843-3e5ed90535d0 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:49.241892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-1776881e-2eab-4255-a366-bd32d5463891 req-2c2f1189-ed90-4b48-8843-3e5ed90535d0 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:49.265012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-1776881e-2eab-4255-a366-bd32d5463891 req-2c2f1189-ed90-4b48-8843-3e5ed90535d0 service nova] Creating event network-changed:1c3fdae4-f9aa-4a9b-9036-d0ab24130b54 for instance 094071af-88ab-4d0b-b351-11aa81077ebd on hv-cinder-79760 Jun 27 14:58:49.279194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-1776881e-2eab-4255-a366-bd32d5463891 req-2c2f1189-ed90-4b48-8843-3e5ed90535d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079935 Jun 27 14:58:49.283097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 231/442] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:58:49.294306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1d004499-955d-4aec-be78-45b238d517b4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:49.295422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1d004499-955d-4aec-be78-45b238d517b4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:49.319352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d004499-955d-4aec-be78-45b238d517b4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:49.319352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d004499-955d-4aec-be78-45b238d517b4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:49.319352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d004499-955d-4aec-be78-45b238d517b4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:49.319791 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d004499-955d-4aec-be78-45b238d517b4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:49.426217 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-26ec0180-6939-400c-82ed-ac6f7359e101 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:49.434938 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-26ec0180-6939-400c-82ed-ac6f7359e101 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.211885 Jun 27 14:58:49.435549 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 212/443] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:49 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:49.469049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1d004499-955d-4aec-be78-45b238d517b4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:49.477954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1d004499-955d-4aec-be78-45b238d517b4 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.193377 Jun 27 14:58:49.478520 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 232/444] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:49 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:50.220450 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-26a4f6d5-baa4-4716-8c1e-1ec367304c86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:50.221026 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-26a4f6d5-baa4-4716-8c1e-1ec367304c86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:50.227503 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-26a4f6d5-baa4-4716-8c1e-1ec367304c86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:50.228541 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-26a4f6d5-baa4-4716-8c1e-1ec367304c86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:50.228741 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-26a4f6d5-baa4-4716-8c1e-1ec367304c86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:50.229180 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-26a4f6d5-baa4-4716-8c1e-1ec367304c86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:50.294652 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-26a4f6d5-baa4-4716-8c1e-1ec367304c86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:50.302721 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-26a4f6d5-baa4-4716-8c1e-1ec367304c86 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1274 microversion: 2.1 time: 0.086325 Jun 27 14:58:50.303274 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 213/445] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:50 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:50.452303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-45381ce4-3a61-4933-aa5e-442530abfd30 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:50.452927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-45381ce4-3a61-4933-aa5e-442530abfd30 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:50.459158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45381ce4-3a61-4933-aa5e-442530abfd30 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:50.459599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45381ce4-3a61-4933-aa5e-442530abfd30 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:50.460378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45381ce4-3a61-4933-aa5e-442530abfd30 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:50.460820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45381ce4-3a61-4933-aa5e-442530abfd30 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:50.495550 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-b6a9ed58-4ca7-4465-aaa0-773858a4ac5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:50.496173 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-b6a9ed58-4ca7-4465-aaa0-773858a4ac5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:50.502205 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b6a9ed58-4ca7-4465-aaa0-773858a4ac5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:50.502742 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b6a9ed58-4ca7-4465-aaa0-773858a4ac5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:50.503758 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b6a9ed58-4ca7-4465-aaa0-773858a4ac5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:50.504198 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b6a9ed58-4ca7-4465-aaa0-773858a4ac5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:50.634869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-45381ce4-3a61-4933-aa5e-442530abfd30 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:50.646489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-45381ce4-3a61-4933-aa5e-442530abfd30 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.197885 Jun 27 14:58:50.646974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 233/446] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:50 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:50.677250 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-b6a9ed58-4ca7-4465-aaa0-773858a4ac5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:50.684823 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-b6a9ed58-4ca7-4465-aaa0-773858a4ac5f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.193125 Jun 27 14:58:50.685315 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 214/447] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:50 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:51.320078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-273555a0-4d3c-4787-91f5-985d2b53cd9a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:51.320736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-273555a0-4d3c-4787-91f5-985d2b53cd9a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:51.326671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-273555a0-4d3c-4787-91f5-985d2b53cd9a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:51.327116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-273555a0-4d3c-4787-91f5-985d2b53cd9a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:51.327870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-273555a0-4d3c-4787-91f5-985d2b53cd9a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:51.328300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-273555a0-4d3c-4787-91f5-985d2b53cd9a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:51.404426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-273555a0-4d3c-4787-91f5-985d2b53cd9a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:51.410754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-273555a0-4d3c-4787-91f5-985d2b53cd9a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1274 microversion: 2.1 time: 0.094405 Jun 27 14:58:51.411733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 234/448] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:51 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:51.663361 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9d067e4f-9266-4d4f-863b-683f0fa7b79f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:51.663971 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-9d067e4f-9266-4d4f-863b-683f0fa7b79f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:51.670925 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9d067e4f-9266-4d4f-863b-683f0fa7b79f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:51.671389 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9d067e4f-9266-4d4f-863b-683f0fa7b79f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:51.672174 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9d067e4f-9266-4d4f-863b-683f0fa7b79f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:51.672616 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9d067e4f-9266-4d4f-863b-683f0fa7b79f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:51.702052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-812fe0cc-3d60-46d4-8521-adf42cd04b4a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:51.702659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-812fe0cc-3d60-46d4-8521-adf42cd04b4a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:51.708868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-812fe0cc-3d60-46d4-8521-adf42cd04b4a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:51.709310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-812fe0cc-3d60-46d4-8521-adf42cd04b4a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:51.710208 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-812fe0cc-3d60-46d4-8521-adf42cd04b4a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:51.710484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-812fe0cc-3d60-46d4-8521-adf42cd04b4a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:51.892613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-812fe0cc-3d60-46d4-8521-adf42cd04b4a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:51.900426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-812fe0cc-3d60-46d4-8521-adf42cd04b4a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.202039 Jun 27 14:58:51.901033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 235/449] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:51 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:52.022232 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9d067e4f-9266-4d4f-863b-683f0fa7b79f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:52.029555 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-9d067e4f-9266-4d4f-863b-683f0fa7b79f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.370064 Jun 27 14:58:52.030113 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 215/450] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:51 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:52.427333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-196881b5-3e1a-4eae-8901-3650af81fc3d tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:52.427933 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-196881b5-3e1a-4eae-8901-3650af81fc3d tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:52.429964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:52.430644 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=12 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:52.435630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-196881b5-3e1a-4eae-8901-3650af81fc3d tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:52.436073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-196881b5-3e1a-4eae-8901-3650af81fc3d tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:52.436870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-196881b5-3e1a-4eae-8901-3650af81fc3d tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:52.437309 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-196881b5-3e1a-4eae-8901-3650af81fc3d tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:52.503940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-196881b5-3e1a-4eae-8901-3650af81fc3d tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:52.511505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-196881b5-3e1a-4eae-8901-3650af81fc3d tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1274 microversion: 2.1 time: 0.088019 Jun 27 14:58:52.512065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 236/451] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:52 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:52.919302 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-96ea0f50-c0e1-4f4a-a0cd-4abffa5682cc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:52.922896 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-96ea0f50-c0e1-4f4a-a0cd-4abffa5682cc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:52.922896 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell0:SELECT=8 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:52.927103 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-96ea0f50-c0e1-4f4a-a0cd-4abffa5682cc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:52.927543 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-96ea0f50-c0e1-4f4a-a0cd-4abffa5682cc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:52.928292 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-96ea0f50-c0e1-4f4a-a0cd-4abffa5682cc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:52.928742 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-96ea0f50-c0e1-4f4a-a0cd-4abffa5682cc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:53.048163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b3cc73b5-ce31-4ce4-9e46-4c41fec608ba tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:53.049755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b3cc73b5-ce31-4ce4-9e46-4c41fec608ba tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:53.056436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b3cc73b5-ce31-4ce4-9e46-4c41fec608ba tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:53.056962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b3cc73b5-ce31-4ce4-9e46-4c41fec608ba tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:53.057729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b3cc73b5-ce31-4ce4-9e46-4c41fec608ba tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:53.058165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b3cc73b5-ce31-4ce4-9e46-4c41fec608ba tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:53.067142 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-96ea0f50-c0e1-4f4a-a0cd-4abffa5682cc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:53.076201 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-96ea0f50-c0e1-4f4a-a0cd-4abffa5682cc tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.160724 Jun 27 14:58:53.076848 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 216/452] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:52 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:53.298299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b3cc73b5-ce31-4ce4-9e46-4c41fec608ba tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:53.306432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b3cc73b5-ce31-4ce4-9e46-4c41fec608ba tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.263155 Jun 27 14:58:53.307004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 237/453] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:53 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:53.529320 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-a77c6102-4ca1-4d2c-bd1d-3c2a0f1d3e54 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:53.529929 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-a77c6102-4ca1-4d2c-bd1d-3c2a0f1d3e54 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:53.536573 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a77c6102-4ca1-4d2c-bd1d-3c2a0f1d3e54 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:53.537113 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a77c6102-4ca1-4d2c-bd1d-3c2a0f1d3e54 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:53.537866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a77c6102-4ca1-4d2c-bd1d-3c2a0f1d3e54 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:53.538298 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a77c6102-4ca1-4d2c-bd1d-3c2a0f1d3e54 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:53.542193 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:53.602648 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-a77c6102-4ca1-4d2c-bd1d-3c2a0f1d3e54 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:53.610035 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-a77c6102-4ca1-4d2c-bd1d-3c2a0f1d3e54 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1274 microversion: 2.1 time: 0.084698 Jun 27 14:58:53.611205 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 217/454] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:53 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:54.094198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1fddf56f-3c56-405e-a0a3-b6c7698d303b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:54.094737 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1fddf56f-3c56-405e-a0a3-b6c7698d303b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:54.101442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1fddf56f-3c56-405e-a0a3-b6c7698d303b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:54.104504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1fddf56f-3c56-405e-a0a3-b6c7698d303b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:54.104504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1fddf56f-3c56-405e-a0a3-b6c7698d303b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:54.104504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1fddf56f-3c56-405e-a0a3-b6c7698d303b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:54.236927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1fddf56f-3c56-405e-a0a3-b6c7698d303b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:54.244310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1fddf56f-3c56-405e-a0a3-b6c7698d303b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.154078 Jun 27 14:58:54.253136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 238/455] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:54 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:54.324659 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-1fb69940-b860-46c8-8797-303c7c46eda1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:54.325309 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-1fb69940-b860-46c8-8797-303c7c46eda1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:54.332683 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1fb69940-b860-46c8-8797-303c7c46eda1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:54.333147 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1fb69940-b860-46c8-8797-303c7c46eda1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:54.333900 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1fb69940-b860-46c8-8797-303c7c46eda1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:54.334329 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1fb69940-b860-46c8-8797-303c7c46eda1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:54.471416 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1fb69940-b860-46c8-8797-303c7c46eda1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:54.479302 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-1fb69940-b860-46c8-8797-303c7c46eda1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.159113 Jun 27 14:58:54.484581 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 218/456] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:54 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:54.628395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d4007b88-e4a4-41a8-8f3b-cddaa66f2de5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:54.628996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d4007b88-e4a4-41a8-8f3b-cddaa66f2de5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:54.635410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d4007b88-e4a4-41a8-8f3b-cddaa66f2de5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:54.635855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d4007b88-e4a4-41a8-8f3b-cddaa66f2de5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:54.636623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d4007b88-e4a4-41a8-8f3b-cddaa66f2de5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:54.637090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d4007b88-e4a4-41a8-8f3b-cddaa66f2de5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:54.713807 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d4007b88-e4a4-41a8-8f3b-cddaa66f2de5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:54.721244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d4007b88-e4a4-41a8-8f3b-cddaa66f2de5 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1274 microversion: 2.1 time: 0.097832 Jun 27 14:58:54.721800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 239/457] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:54 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:55.261464 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-5c5d9c40-da56-4cdf-84e7-81ebecfbf9b7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:55.262089 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-5c5d9c40-da56-4cdf-84e7-81ebecfbf9b7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:55.268389 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5c5d9c40-da56-4cdf-84e7-81ebecfbf9b7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:55.268902 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5c5d9c40-da56-4cdf-84e7-81ebecfbf9b7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:55.269658 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5c5d9c40-da56-4cdf-84e7-81ebecfbf9b7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:55.270096 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5c5d9c40-da56-4cdf-84e7-81ebecfbf9b7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:55.399773 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-5c5d9c40-da56-4cdf-84e7-81ebecfbf9b7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:55.407402 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-5c5d9c40-da56-4cdf-84e7-81ebecfbf9b7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.149665 Jun 27 14:58:55.408462 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 219/458] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:55 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:55.496028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0d7a5555-ea1f-4e71-89fd-716572889a8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:55.496635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0d7a5555-ea1f-4e71-89fd-716572889a8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:55.502709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d7a5555-ea1f-4e71-89fd-716572889a8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:55.503150 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d7a5555-ea1f-4e71-89fd-716572889a8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:55.503898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d7a5555-ea1f-4e71-89fd-716572889a8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:55.504328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d7a5555-ea1f-4e71-89fd-716572889a8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:55.633463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0d7a5555-ea1f-4e71-89fd-716572889a8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:55.640780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0d7a5555-ea1f-4e71-89fd-716572889a8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.148698 Jun 27 14:58:55.641333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 240/459] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:55 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:55.738527 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9c8d451c-06c5-45c5-873b-d7e3024409ea tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:55.739135 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-9c8d451c-06c5-45c5-873b-d7e3024409ea tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:55.745135 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9c8d451c-06c5-45c5-873b-d7e3024409ea tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:55.745582 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9c8d451c-06c5-45c5-873b-d7e3024409ea tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:55.746331 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9c8d451c-06c5-45c5-873b-d7e3024409ea tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:55.746761 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9c8d451c-06c5-45c5-873b-d7e3024409ea tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:55.806635 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9c8d451c-06c5-45c5-873b-d7e3024409ea tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:55.814272 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-9c8d451c-06c5-45c5-873b-d7e3024409ea tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1274 microversion: 2.1 time: 0.080111 Jun 27 14:58:55.814823 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 220/460] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:55 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:56.424619 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3f5e57df-9748-4016-b075-085deb977404 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:56.425278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3f5e57df-9748-4016-b075-085deb977404 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:56.431253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f5e57df-9748-4016-b075-085deb977404 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:56.431696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f5e57df-9748-4016-b075-085deb977404 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:56.432443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f5e57df-9748-4016-b075-085deb977404 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:56.432899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f5e57df-9748-4016-b075-085deb977404 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:56.558401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3f5e57df-9748-4016-b075-085deb977404 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:56.567061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3f5e57df-9748-4016-b075-085deb977404 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.146337 Jun 27 14:58:56.567628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 241/461] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:56 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:56.656725 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4663f73e-0cab-43c3-894b-5e9e8e3bcb47 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:56.661629 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4663f73e-0cab-43c3-894b-5e9e8e3bcb47 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:56.664113 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4663f73e-0cab-43c3-894b-5e9e8e3bcb47 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:56.664560 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4663f73e-0cab-43c3-894b-5e9e8e3bcb47 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:56.665357 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4663f73e-0cab-43c3-894b-5e9e8e3bcb47 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:56.665789 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4663f73e-0cab-43c3-894b-5e9e8e3bcb47 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:56.797635 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4663f73e-0cab-43c3-894b-5e9e8e3bcb47 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:56.805177 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4663f73e-0cab-43c3-894b-5e9e8e3bcb47 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.152338 Jun 27 14:58:56.805759 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 221/462] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:56 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:56.831238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f93c1b3a-ca1a-41bb-8769-79cd7dc269c8 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:56.831867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f93c1b3a-ca1a-41bb-8769-79cd7dc269c8 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:56.838017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f93c1b3a-ca1a-41bb-8769-79cd7dc269c8 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:56.838434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f93c1b3a-ca1a-41bb-8769-79cd7dc269c8 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:56.839173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f93c1b3a-ca1a-41bb-8769-79cd7dc269c8 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:56.839597 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f93c1b3a-ca1a-41bb-8769-79cd7dc269c8 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:56.902746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f93c1b3a-ca1a-41bb-8769-79cd7dc269c8 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:56.910145 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f93c1b3a-ca1a-41bb-8769-79cd7dc269c8 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1274 microversion: 2.1 time: 0.083421 Jun 27 14:58:56.910702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 242/463] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:56 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:57.587719 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4f5e7e0d-7128-408f-8528-cac95895f884 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:57.588360 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4f5e7e0d-7128-408f-8528-cac95895f884 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:57.596602 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f5e7e0d-7128-408f-8528-cac95895f884 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:57.597349 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f5e7e0d-7128-408f-8528-cac95895f884 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:57.598453 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f5e7e0d-7128-408f-8528-cac95895f884 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:57.599206 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4f5e7e0d-7128-408f-8528-cac95895f884 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:57.810203 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4f5e7e0d-7128-408f-8528-cac95895f884 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:57.818093 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4f5e7e0d-7128-408f-8528-cac95895f884 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.237807 Jun 27 14:58:57.818645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 222/464] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:57 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:57.822809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-93ba48cf-0542-4da4-95df-3c4db3db4607 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:57.823414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-93ba48cf-0542-4da4-95df-3c4db3db4607 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:57.830218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93ba48cf-0542-4da4-95df-3c4db3db4607 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:57.830742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93ba48cf-0542-4da4-95df-3c4db3db4607 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:57.831508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93ba48cf-0542-4da4-95df-3c4db3db4607 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:57.831946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93ba48cf-0542-4da4-95df-3c4db3db4607 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:57.928183 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-fd172f6d-f358-42c4-91ce-5255404cc1f6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:57.929030 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-fd172f6d-f358-42c4-91ce-5255404cc1f6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:57.935269 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fd172f6d-f358-42c4-91ce-5255404cc1f6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:57.935873 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fd172f6d-f358-42c4-91ce-5255404cc1f6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:57.936720 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fd172f6d-f358-42c4-91ce-5255404cc1f6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:57.937247 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-fd172f6d-f358-42c4-91ce-5255404cc1f6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:57.959999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-93ba48cf-0542-4da4-95df-3c4db3db4607 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:57.967417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-93ba48cf-0542-4da4-95df-3c4db3db4607 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.148434 Jun 27 14:58:57.967973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 243/465] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:57 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:58.003430 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-fd172f6d-f358-42c4-91ce-5255404cc1f6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:58.010866 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-fd172f6d-f358-42c4-91ce-5255404cc1f6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1284 microversion: 2.1 time: 0.088735 Jun 27 14:58:58.011418 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 223/466] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:57 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:58.834804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bc0a395c-b6db-4708-bc9c-c8b6138759b5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:58.836113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bc0a395c-b6db-4708-bc9c-c8b6138759b5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:58.843880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc0a395c-b6db-4708-bc9c-c8b6138759b5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:58.845130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc0a395c-b6db-4708-bc9c-c8b6138759b5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:58.846371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc0a395c-b6db-4708-bc9c-c8b6138759b5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:58.846977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc0a395c-b6db-4708-bc9c-c8b6138759b5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:58.986310 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-a5b7d8df-7a17-4939-8f20-0278427e606a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:58.987192 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-a5b7d8df-7a17-4939-8f20-0278427e606a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:58.993813 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a5b7d8df-7a17-4939-8f20-0278427e606a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:58.994615 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a5b7d8df-7a17-4939-8f20-0278427e606a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:58.995444 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a5b7d8df-7a17-4939-8f20-0278427e606a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:58.995944 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a5b7d8df-7a17-4939-8f20-0278427e606a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:58.999374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bc0a395c-b6db-4708-bc9c-c8b6138759b5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:59.007502 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bc0a395c-b6db-4708-bc9c-c8b6138759b5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.177441 Jun 27 14:58:59.008072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 244/467] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:58 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:58:59.031330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e9e6c40d-90f3-4984-ad94-21e961cc5c91 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:58:59.032009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e9e6c40d-90f3-4984-ad94-21e961cc5c91 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:58:59.039188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9e6c40d-90f3-4984-ad94-21e961cc5c91 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:59.039635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9e6c40d-90f3-4984-ad94-21e961cc5c91 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:59.040404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9e6c40d-90f3-4984-ad94-21e961cc5c91 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:58:59.040871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9e6c40d-90f3-4984-ad94-21e961cc5c91 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:58:59.045404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:59.107388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e9e6c40d-90f3-4984-ad94-21e961cc5c91 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:59.117452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e9e6c40d-90f3-4984-ad94-21e961cc5c91 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1272 microversion: 2.1 time: 0.090013 Jun 27 14:58:59.127550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 245/468] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:59 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:58:59.186325 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-a5b7d8df-7a17-4939-8f20-0278427e606a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:58:59.197122 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-a5b7d8df-7a17-4939-8f20-0278427e606a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.214914 Jun 27 14:58:59.197705 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 224/469] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:58:58 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:00.024069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-28e884db-0bd6-4f6a-ba27-9931873bce69 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:00.026027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-28e884db-0bd6-4f6a-ba27-9931873bce69 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:00.030760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-28e884db-0bd6-4f6a-ba27-9931873bce69 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:00.031214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-28e884db-0bd6-4f6a-ba27-9931873bce69 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:00.032007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-28e884db-0bd6-4f6a-ba27-9931873bce69 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:00.033207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-28e884db-0bd6-4f6a-ba27-9931873bce69 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:00.151435 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-c1f0c82f-dbec-429d-bf52-387f0c865c4c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:00.152007 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-c1f0c82f-dbec-429d-bf52-387f0c865c4c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:00.161107 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c1f0c82f-dbec-429d-bf52-387f0c865c4c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:00.169828 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c1f0c82f-dbec-429d-bf52-387f0c865c4c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:00.175225 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c1f0c82f-dbec-429d-bf52-387f0c865c4c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:00.175683 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-c1f0c82f-dbec-429d-bf52-387f0c865c4c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:00.192898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-28e884db-0bd6-4f6a-ba27-9931873bce69 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:00.202620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-28e884db-0bd6-4f6a-ba27-9931873bce69 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.181620 Jun 27 14:59:00.213430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 246/470] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:00 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:00.220258 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d67bc087-61fb-4ba7-a9ed-2106094b3ede tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:00.221293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d67bc087-61fb-4ba7-a9ed-2106094b3ede tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:00.227438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d67bc087-61fb-4ba7-a9ed-2106094b3ede tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:00.227891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d67bc087-61fb-4ba7-a9ed-2106094b3ede tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:00.228707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d67bc087-61fb-4ba7-a9ed-2106094b3ede tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:00.229128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d67bc087-61fb-4ba7-a9ed-2106094b3ede tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:00.471061 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-c1f0c82f-dbec-429d-bf52-387f0c865c4c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:00.480184 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-c1f0c82f-dbec-429d-bf52-387f0c865c4c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.344389 Jun 27 14:59:00.480903 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 225/471] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:00 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:00.602751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d67bc087-61fb-4ba7-a9ed-2106094b3ede tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:00.610810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d67bc087-61fb-4ba7-a9ed-2106094b3ede tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.395830 Jun 27 14:59:00.611365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 247/472] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:00 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:00.990372 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-dcba891e-57ad-42dc-be59-364a40db9095 req-c566fb69-54a1-4679-81a4-a45a6844472e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e0606f-8bab-4c30-ae7e-82708c23e054", "tag": "5d2059ae-f1b6-46f6-b474-af4d48ffa6ee"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:00.999267 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-dcba891e-57ad-42dc-be59-364a40db9095 req-c566fb69-54a1-4679-81a4-a45a6844472e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:00.999782 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-dcba891e-57ad-42dc-be59-364a40db9095 req-c566fb69-54a1-4679-81a4-a45a6844472e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.013405 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-dcba891e-57ad-42dc-be59-364a40db9095 req-c566fb69-54a1-4679-81a4-a45a6844472e service nova] Creating event network-changed:5d2059ae-f1b6-46f6-b474-af4d48ffa6ee for instance 78e0606f-8bab-4c30-ae7e-82708c23e054 on hv-cinder-79760 Jun 27 14:59:01.019050 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-dcba891e-57ad-42dc-be59-364a40db9095 req-c566fb69-54a1-4679-81a4-a45a6844472e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032336 Jun 27 14:59:01.019650 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 226/473] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:59:01.224793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4f401b15-0aef-46a6-b2c2-14d2768d7545 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:01.225399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4f401b15-0aef-46a6-b2c2-14d2768d7545 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:01.231742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f401b15-0aef-46a6-b2c2-14d2768d7545 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.232348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f401b15-0aef-46a6-b2c2-14d2768d7545 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.234456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f401b15-0aef-46a6-b2c2-14d2768d7545 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.234906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f401b15-0aef-46a6-b2c2-14d2768d7545 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.366708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4f401b15-0aef-46a6-b2c2-14d2768d7545 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:01.374068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4f401b15-0aef-46a6-b2c2-14d2768d7545 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.153140 Jun 27 14:59:01.374615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 248/474] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:01 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:01.498898 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-51152de3-7de8-4395-bef5-92fa2a4599be tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:01.499595 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-51152de3-7de8-4395-bef5-92fa2a4599be tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:01.506752 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-51152de3-7de8-4395-bef5-92fa2a4599be tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.507197 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-51152de3-7de8-4395-bef5-92fa2a4599be tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.507954 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-51152de3-7de8-4395-bef5-92fa2a4599be tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.508386 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-51152de3-7de8-4395-bef5-92fa2a4599be tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.628024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-20dfb253-0a1b-40db-b1f7-261d3ec32fcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:01.628545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-20dfb253-0a1b-40db-b1f7-261d3ec32fcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:01.634463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20dfb253-0a1b-40db-b1f7-261d3ec32fcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.634913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20dfb253-0a1b-40db-b1f7-261d3ec32fcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.635672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20dfb253-0a1b-40db-b1f7-261d3ec32fcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.636104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20dfb253-0a1b-40db-b1f7-261d3ec32fcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.637241 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-51152de3-7de8-4395-bef5-92fa2a4599be tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:01.644916 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-51152de3-7de8-4395-bef5-92fa2a4599be tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.150650 Jun 27 14:59:01.645481 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 227/475] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:01 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:01.768492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-20dfb253-0a1b-40db-b1f7-261d3ec32fcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:01.775811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-20dfb253-0a1b-40db-b1f7-261d3ec32fcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1503 microversion: 2.1 time: 0.152481 Jun 27 14:59:01.776365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 249/476] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:01 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:01.793230 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a96b2de-2c6a-46c9-b50e-26bee9d9dc57"}} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:01.794357 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:01.800949 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.801394 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.802170 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.802605 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.824985 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.wsgi [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] HTTP exception thrown: Cannot 'attach_volume' instance bbec56f5-672a-4067-8656-c5d152daef90 while it is in vm_state rescued Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Request method failure captured: Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: request: POST /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90/os-volume_attachments HTTP/1.1 Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Accept: application/json Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Accept-Encoding: identity Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Connection: close Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Content-Length: 74 Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Content-Type: application/json Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Host: 10.222.0.44 Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Openstack-System-Scope: None Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: User-Agent: python-urllib3/1.26.9 Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Auth-Token: gAAAAABiucT-38-AhZx4ML0BgmtKnzrQGmAeYhVKp5jKaqxQFcQnA7Kr9cre3Cu91khx_2JaOxjv9r1Z9kio4dNU5xXRpzSPMGfJKKbnGnmOtztAdqgT6r_4hXcpZK59VXJPjHLS4pE-eo4l84UTzV0RLVRBOIDSf2e9NbVw6MW1nFAV0jqhI38 Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Domain-Id: None Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Domain-Name: None Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Identity-Status: Confirmed Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Is-Admin-Project: True Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Project-Domain-Id: default Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Project-Domain-Name: Default Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Project-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Role: member,reader Jun 27 14:59:01.826645 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Roles: member,reader Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Tenant-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User-Domain-Id: default Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User-Domain-Name: Default Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User-Id: 27b0e2428571450ea1d5edfd1c3b0f80 Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: {"volumeAttachment": {"volumeId": "5a96b2de-2c6a-46c9-b50e-26bee9d9dc57"}} Jun 27 14:59:01.828314 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: method: > Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: exception: Cannot 'attach_volume' instance bbec56f5-672a-4067-8656-c5d152daef90 while it is in vm_state rescued Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: action_args: {'server_id': 'bbec56f5-672a-4067-8656-c5d152daef90', 'body': {'volumeAttachment': {'volumeId': '5a96b2de-2c6a-46c9-b50e-26bee9d9dc57'}}} Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bbec56f5-672a-4067-8656-c5d152daef90 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:59:01.829293 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bbec56f5-672a-4067-8656-c5d152daef90 while it is in vm_state rescued Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:59:01.831130 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:59:01.832523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:59:01.832523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:59:01.832523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bbec56f5-672a-4067-8656-c5d152daef90 while it is in vm_state rescued Jun 27 14:59:01.832523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: ERROR nova.api.openstack.wsgi Jun 27 14:59:01.832523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Returning 409 to user: Cannot 'attach_volume' instance bbec56f5-672a-4067-8656-c5d152daef90 while it is in vm_state rescued {{(pid=129686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:59:01.832523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-75b350da-3afd-40df-9047-6aca2f9ac8a8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039006 Jun 27 14:59:01.832523 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 228/477] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 14:59:01 2022] POST /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 14:59:01.837427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-dca1cc49-b2f2-466b-b869-1340ca65c814 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:01.837949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-dca1cc49-b2f2-466b-b869-1340ca65c814 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:01.843825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dca1cc49-b2f2-466b-b869-1340ca65c814 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.844266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dca1cc49-b2f2-466b-b869-1340ca65c814 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:01.845567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dca1cc49-b2f2-466b-b869-1340ca65c814 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:01.845983 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dca1cc49-b2f2-466b-b869-1340ca65c814 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:02.070287 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-dca1cc49-b2f2-466b-b869-1340ca65c814 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90/action" status: 202 len: 0 microversion: 2.1 time: 0.236496 Jun 27 14:59:02.070913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 250/478] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 14:59:01 2022] POST /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 14:59:02.078841 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-05e571b6-bc18-48be-9658-cac5af2448f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:02.080104 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-05e571b6-bc18-48be-9658-cac5af2448f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:02.086824 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-05e571b6-bc18-48be-9658-cac5af2448f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:02.087495 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-05e571b6-bc18-48be-9658-cac5af2448f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:02.088352 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-05e571b6-bc18-48be-9658-cac5af2448f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:02.088910 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-05e571b6-bc18-48be-9658-cac5af2448f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:02.222234 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-05e571b6-bc18-48be-9658-cac5af2448f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:02.229676 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-05e571b6-bc18-48be-9658-cac5af2448f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.154645 Jun 27 14:59:02.230234 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 229/479] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:02 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:02.391101 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-534b78a7-3ba9-41b2-8219-f32374c26744 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:02.392325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-534b78a7-3ba9-41b2-8219-f32374c26744 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:02.398472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-534b78a7-3ba9-41b2-8219-f32374c26744 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:02.398944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-534b78a7-3ba9-41b2-8219-f32374c26744 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:02.399689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-534b78a7-3ba9-41b2-8219-f32374c26744 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:02.400141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-534b78a7-3ba9-41b2-8219-f32374c26744 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:02.531364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-534b78a7-3ba9-41b2-8219-f32374c26744 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:02.539098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-534b78a7-3ba9-41b2-8219-f32374c26744 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.152432 Jun 27 14:59:02.539661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 251/480] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:02 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:02.662040 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-a048822f-8975-4550-9ada-f575525fa279 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:02.662668 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-a048822f-8975-4550-9ada-f575525fa279 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:02.669111 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a048822f-8975-4550-9ada-f575525fa279 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:02.669556 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a048822f-8975-4550-9ada-f575525fa279 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:02.670301 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a048822f-8975-4550-9ada-f575525fa279 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:02.670726 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-a048822f-8975-4550-9ada-f575525fa279 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:02.807117 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-a048822f-8975-4550-9ada-f575525fa279 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:02.815168 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-a048822f-8975-4550-9ada-f575525fa279 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.156940 Jun 27 14:59:02.815715 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 230/481] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:02 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:03.247615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3e47df47-5bba-4536-9a61-9fa81e623984 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:03.248150 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3e47df47-5bba-4536-9a61-9fa81e623984 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:03.254311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e47df47-5bba-4536-9a61-9fa81e623984 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:03.254755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e47df47-5bba-4536-9a61-9fa81e623984 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:03.255509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e47df47-5bba-4536-9a61-9fa81e623984 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:03.255942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e47df47-5bba-4536-9a61-9fa81e623984 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:03.386156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3e47df47-5bba-4536-9a61-9fa81e623984 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:03.393835 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3e47df47-5bba-4536-9a61-9fa81e623984 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.150337 Jun 27 14:59:03.394621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 252/482] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:03 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:03.555563 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-1ca4fb95-98b3-4ab5-b01f-cab485ce751d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:03.556127 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-1ca4fb95-98b3-4ab5-b01f-cab485ce751d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:03.562188 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1ca4fb95-98b3-4ab5-b01f-cab485ce751d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:03.562635 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1ca4fb95-98b3-4ab5-b01f-cab485ce751d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:03.563753 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1ca4fb95-98b3-4ab5-b01f-cab485ce751d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:03.564193 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-1ca4fb95-98b3-4ab5-b01f-cab485ce751d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:03.690260 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-1ca4fb95-98b3-4ab5-b01f-cab485ce751d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:03.697555 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-1ca4fb95-98b3-4ab5-b01f-cab485ce751d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.145915 Jun 27 14:59:03.698103 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 231/483] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:03 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:03.831696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e759aadd-9548-42db-8d5a-bb821c755a2b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:03.832225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e759aadd-9548-42db-8d5a-bb821c755a2b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:03.838432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e759aadd-9548-42db-8d5a-bb821c755a2b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:03.838874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e759aadd-9548-42db-8d5a-bb821c755a2b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:03.839622 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e759aadd-9548-42db-8d5a-bb821c755a2b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:03.840046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e759aadd-9548-42db-8d5a-bb821c755a2b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:03.965342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e759aadd-9548-42db-8d5a-bb821c755a2b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:03.973328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e759aadd-9548-42db-8d5a-bb821c755a2b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.145534 Jun 27 14:59:03.973891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 253/484] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:03 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:04.411966 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-ff619b81-f4f4-4789-92fe-8e87d7ef78b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:04.412607 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-ff619b81-f4f4-4789-92fe-8e87d7ef78b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:04.418815 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ff619b81-f4f4-4789-92fe-8e87d7ef78b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:04.419259 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ff619b81-f4f4-4789-92fe-8e87d7ef78b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:04.420009 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ff619b81-f4f4-4789-92fe-8e87d7ef78b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:04.420439 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-ff619b81-f4f4-4789-92fe-8e87d7ef78b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:04.554182 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-ff619b81-f4f4-4789-92fe-8e87d7ef78b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:04.561567 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-ff619b81-f4f4-4789-92fe-8e87d7ef78b1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.154331 Jun 27 14:59:04.562129 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 232/485] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:04 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:04.714142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-91a64e75-54b1-4ae4-8237-4d90154a7d56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:04.714750 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-91a64e75-54b1-4ae4-8237-4d90154a7d56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:04.721675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-91a64e75-54b1-4ae4-8237-4d90154a7d56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:04.722119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-91a64e75-54b1-4ae4-8237-4d90154a7d56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:04.722869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-91a64e75-54b1-4ae4-8237-4d90154a7d56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:04.723298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-91a64e75-54b1-4ae4-8237-4d90154a7d56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:04.847173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-91a64e75-54b1-4ae4-8237-4d90154a7d56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:04.854549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-91a64e75-54b1-4ae4-8237-4d90154a7d56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.144224 Jun 27 14:59:04.855107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 254/486] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:04 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:04.989660 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-606439d6-e63c-4cc7-a465-9b06ccd750ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:04.990216 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-606439d6-e63c-4cc7-a465-9b06ccd750ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:04.996563 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-606439d6-e63c-4cc7-a465-9b06ccd750ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:04.997039 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-606439d6-e63c-4cc7-a465-9b06ccd750ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:04.997794 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-606439d6-e63c-4cc7-a465-9b06ccd750ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:04.998225 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-606439d6-e63c-4cc7-a465-9b06ccd750ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:05.133177 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-606439d6-e63c-4cc7-a465-9b06ccd750ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:05.140502 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-606439d6-e63c-4cc7-a465-9b06ccd750ec tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.154919 Jun 27 14:59:05.141081 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 233/487] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:04 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:05.579246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0d3a061d-6637-41be-898b-397acb55cb3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:05.579846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0d3a061d-6637-41be-898b-397acb55cb3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:05.585783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d3a061d-6637-41be-898b-397acb55cb3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:05.586226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d3a061d-6637-41be-898b-397acb55cb3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:05.586969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d3a061d-6637-41be-898b-397acb55cb3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:05.587392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d3a061d-6637-41be-898b-397acb55cb3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:05.715989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0d3a061d-6637-41be-898b-397acb55cb3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:05.723887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0d3a061d-6637-41be-898b-397acb55cb3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.148566 Jun 27 14:59:05.724444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 255/488] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:05 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:05.871225 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4c89295c-64e1-4d9e-b73a-ec78dc9c1dac tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:05.871825 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4c89295c-64e1-4d9e-b73a-ec78dc9c1dac tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:05.877892 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4c89295c-64e1-4d9e-b73a-ec78dc9c1dac tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:05.878330 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4c89295c-64e1-4d9e-b73a-ec78dc9c1dac tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:05.879073 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4c89295c-64e1-4d9e-b73a-ec78dc9c1dac tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:05.879495 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4c89295c-64e1-4d9e-b73a-ec78dc9c1dac tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:06.003972 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4c89295c-64e1-4d9e-b73a-ec78dc9c1dac tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:06.007403 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_cell1:SELECT=100 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:06.011756 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4c89295c-64e1-4d9e-b73a-ec78dc9c1dac tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.144356 Jun 27 14:59:06.012307 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 234/489] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:05 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:06.157657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-61dc63dd-a86f-4453-bb2a-62697cf89839 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:06.158259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-61dc63dd-a86f-4453-bb2a-62697cf89839 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:06.164133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61dc63dd-a86f-4453-bb2a-62697cf89839 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:06.164575 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61dc63dd-a86f-4453-bb2a-62697cf89839 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:06.165356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61dc63dd-a86f-4453-bb2a-62697cf89839 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:06.165798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61dc63dd-a86f-4453-bb2a-62697cf89839 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:06.289927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-61dc63dd-a86f-4453-bb2a-62697cf89839 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:06.297148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-61dc63dd-a86f-4453-bb2a-62697cf89839 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.144102 Jun 27 14:59:06.297719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 256/490] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:06 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:06.741990 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d7bfcf97-196a-4d71-b9cf-74338d786f82 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:06.742591 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d7bfcf97-196a-4d71-b9cf-74338d786f82 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:06.748618 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d7bfcf97-196a-4d71-b9cf-74338d786f82 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:06.749082 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d7bfcf97-196a-4d71-b9cf-74338d786f82 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:06.749847 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d7bfcf97-196a-4d71-b9cf-74338d786f82 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:06.750283 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d7bfcf97-196a-4d71-b9cf-74338d786f82 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:06.878675 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d7bfcf97-196a-4d71-b9cf-74338d786f82 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:06.886166 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d7bfcf97-196a-4d71-b9cf-74338d786f82 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.148451 Jun 27 14:59:06.886720 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 235/491] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:06 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:07.028052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-99aa5471-cfb5-4cb9-81dd-dec6d35f1fe6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:07.028670 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-99aa5471-cfb5-4cb9-81dd-dec6d35f1fe6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:07.035310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99aa5471-cfb5-4cb9-81dd-dec6d35f1fe6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:07.035781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99aa5471-cfb5-4cb9-81dd-dec6d35f1fe6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:07.036533 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99aa5471-cfb5-4cb9-81dd-dec6d35f1fe6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:07.036995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99aa5471-cfb5-4cb9-81dd-dec6d35f1fe6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:07.169046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-99aa5471-cfb5-4cb9-81dd-dec6d35f1fe6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:07.177051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-99aa5471-cfb5-4cb9-81dd-dec6d35f1fe6 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.152857 Jun 27 14:59:07.181960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 257/492] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:07 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:07.312902 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-b995eb5c-9637-4cae-860a-831cc02192df tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:07.313871 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-b995eb5c-9637-4cae-860a-831cc02192df tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:07.320256 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b995eb5c-9637-4cae-860a-831cc02192df tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:07.320716 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b995eb5c-9637-4cae-860a-831cc02192df tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:07.321467 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b995eb5c-9637-4cae-860a-831cc02192df tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:07.321900 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b995eb5c-9637-4cae-860a-831cc02192df tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:07.448248 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-b995eb5c-9637-4cae-860a-831cc02192df tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:07.456183 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-b995eb5c-9637-4cae-860a-831cc02192df tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.147141 Jun 27 14:59:07.456881 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 236/493] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:07 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:07.903733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a5ddb2c8-74f3-40fd-93c8-e365b5344881 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:07.904467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a5ddb2c8-74f3-40fd-93c8-e365b5344881 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:07.911219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5ddb2c8-74f3-40fd-93c8-e365b5344881 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:07.914621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5ddb2c8-74f3-40fd-93c8-e365b5344881 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:07.914621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5ddb2c8-74f3-40fd-93c8-e365b5344881 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:07.914621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a5ddb2c8-74f3-40fd-93c8-e365b5344881 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:08.042183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a5ddb2c8-74f3-40fd-93c8-e365b5344881 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:08.050105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a5ddb2c8-74f3-40fd-93c8-e365b5344881 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.150705 Jun 27 14:59:08.050666 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 258/494] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:07 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:08.194474 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-d90e1779-dde5-49db-9cf2-0b9b1074c2d2 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:08.195078 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-d90e1779-dde5-49db-9cf2-0b9b1074c2d2 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:08.201393 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d90e1779-dde5-49db-9cf2-0b9b1074c2d2 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:08.201834 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d90e1779-dde5-49db-9cf2-0b9b1074c2d2 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:08.202579 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d90e1779-dde5-49db-9cf2-0b9b1074c2d2 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:08.203005 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-d90e1779-dde5-49db-9cf2-0b9b1074c2d2 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:08.339075 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-d90e1779-dde5-49db-9cf2-0b9b1074c2d2 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:08.346467 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-d90e1779-dde5-49db-9cf2-0b9b1074c2d2 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.155868 Jun 27 14:59:08.347026 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 237/495] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:08 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:08.473353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c62b45b4-db29-4f00-8219-500ec38fa90c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:08.474096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c62b45b4-db29-4f00-8219-500ec38fa90c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:08.480014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c62b45b4-db29-4f00-8219-500ec38fa90c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:08.480453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c62b45b4-db29-4f00-8219-500ec38fa90c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:08.481242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c62b45b4-db29-4f00-8219-500ec38fa90c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:08.481674 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c62b45b4-db29-4f00-8219-500ec38fa90c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:08.536008 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-5841d8bd-b5c6-4168-a3ab-4af357d32eb2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:08.536543 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-5841d8bd-b5c6-4168-a3ab-4af357d32eb2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:08.542776 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5841d8bd-b5c6-4168-a3ab-4af357d32eb2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:08.543243 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5841d8bd-b5c6-4168-a3ab-4af357d32eb2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:08.544000 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5841d8bd-b5c6-4168-a3ab-4af357d32eb2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:08.544443 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-5841d8bd-b5c6-4168-a3ab-4af357d32eb2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:08.621126 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c62b45b4-db29-4f00-8219-500ec38fa90c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:08.632302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c62b45b4-db29-4f00-8219-500ec38fa90c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.163329 Jun 27 14:59:08.633323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 259/496] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:08 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:08.675561 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.objects.instance [None req-5841d8bd-b5c6-4168-a3ab-4af357d32eb2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lazy-loading 'services' on Instance uuid fa9eabcc-8bc7-4501-b977-641ffd6bc5be {{(pid=129686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:59:08.914925 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-5841d8bd-b5c6-4168-a3ab-4af357d32eb2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be/os-volume_attachments/49d6d3ce-de82-4294-a96d-5e0718db76a3" status: 202 len: 0 microversion: 2.1 time: 0.383212 Jun 27 14:59:08.915519 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 238/497] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 14:59:08 2022] DELETE /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be/os-volume_attachments/49d6d3ce-de82-4294-a96d-5e0718db76a3 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 14:59:09.067723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-756841c3-803f-444f-a46a-6186dab088c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:09.068325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-756841c3-803f-444f-a46a-6186dab088c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:09.074437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-756841c3-803f-444f-a46a-6186dab088c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:09.075000 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-756841c3-803f-444f-a46a-6186dab088c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:09.075745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-756841c3-803f-444f-a46a-6186dab088c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:09.076170 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-756841c3-803f-444f-a46a-6186dab088c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:09.208371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-756841c3-803f-444f-a46a-6186dab088c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:09.213650 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:09.222192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-756841c3-803f-444f-a46a-6186dab088c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.158473 Jun 27 14:59:09.222837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 260/498] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:09 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:09.364017 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6ef0c9aa-5537-42f5-96c4-d31ae20db578 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:09.364754 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6ef0c9aa-5537-42f5-96c4-d31ae20db578 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:09.366655 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG dbcounter [-] [129686] Writing DB stats nova_api:SELECT=86 {{(pid=129686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:09.371701 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6ef0c9aa-5537-42f5-96c4-d31ae20db578 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:09.372155 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6ef0c9aa-5537-42f5-96c4-d31ae20db578 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:09.372919 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6ef0c9aa-5537-42f5-96c4-d31ae20db578 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:09.373352 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6ef0c9aa-5537-42f5-96c4-d31ae20db578 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:09.503219 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6ef0c9aa-5537-42f5-96c4-d31ae20db578 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:09.510693 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6ef0c9aa-5537-42f5-96c4-d31ae20db578 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.151358 Jun 27 14:59:09.511259 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 239/499] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:09 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:09.649561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bf7606d5-ac03-41a9-812e-348451b281e7 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:09.650160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bf7606d5-ac03-41a9-812e-348451b281e7 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:09.652763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:09.657707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf7606d5-ac03-41a9-812e-348451b281e7 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:09.658143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf7606d5-ac03-41a9-812e-348451b281e7 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:09.658889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf7606d5-ac03-41a9-812e-348451b281e7 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:09.659310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf7606d5-ac03-41a9-812e-348451b281e7 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:09.792052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bf7606d5-ac03-41a9-812e-348451b281e7 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:09.799535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bf7606d5-ac03-41a9-812e-348451b281e7 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.153879 Jun 27 14:59:09.800086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 261/500] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:09 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:10.239253 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-4760bf70-1e36-4dac-8559-0ce0ba8382c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:10.239865 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-4760bf70-1e36-4dac-8559-0ce0ba8382c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:10.253993 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4760bf70-1e36-4dac-8559-0ce0ba8382c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:10.254443 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4760bf70-1e36-4dac-8559-0ce0ba8382c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:10.255247 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4760bf70-1e36-4dac-8559-0ce0ba8382c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:10.255690 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-4760bf70-1e36-4dac-8559-0ce0ba8382c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:10.469836 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-4760bf70-1e36-4dac-8559-0ce0ba8382c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:10.477743 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-4760bf70-1e36-4dac-8559-0ce0ba8382c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.242377 Jun 27 14:59:10.478307 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 240/501] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:10 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:10.528609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1918a688-6cb6-4c6a-b656-2a29ff69668f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:10.529315 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1918a688-6cb6-4c6a-b656-2a29ff69668f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:10.536319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1918a688-6cb6-4c6a-b656-2a29ff69668f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:10.536864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1918a688-6cb6-4c6a-b656-2a29ff69668f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:10.537628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1918a688-6cb6-4c6a-b656-2a29ff69668f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:10.538055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1918a688-6cb6-4c6a-b656-2a29ff69668f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:10.675346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1918a688-6cb6-4c6a-b656-2a29ff69668f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:10.683495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1918a688-6cb6-4c6a-b656-2a29ff69668f tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.158883 Jun 27 14:59:10.684832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 262/502] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:10 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:10.818850 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-968fa75b-04f3-4f35-8bda-3b6c28c50b8f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:10.820680 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-968fa75b-04f3-4f35-8bda-3b6c28c50b8f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:10.827515 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-968fa75b-04f3-4f35-8bda-3b6c28c50b8f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:10.827960 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-968fa75b-04f3-4f35-8bda-3b6c28c50b8f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:10.829750 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-968fa75b-04f3-4f35-8bda-3b6c28c50b8f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:10.830178 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-968fa75b-04f3-4f35-8bda-3b6c28c50b8f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:11.381330 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-968fa75b-04f3-4f35-8bda-3b6c28c50b8f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:11.388928 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-968fa75b-04f3-4f35-8bda-3b6c28c50b8f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.576211 Jun 27 14:59:11.389500 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 241/503] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:10 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:11.495663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fbc0ee45-fb0f-4e4a-9a69-f8f7e5865a3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:11.496380 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fbc0ee45-fb0f-4e4a-9a69-f8f7e5865a3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:11.504120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc0ee45-fb0f-4e4a-9a69-f8f7e5865a3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:11.506755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc0ee45-fb0f-4e4a-9a69-f8f7e5865a3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:11.507696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc0ee45-fb0f-4e4a-9a69-f8f7e5865a3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:11.508329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc0ee45-fb0f-4e4a-9a69-f8f7e5865a3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:11.650109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fbc0ee45-fb0f-4e4a-9a69-f8f7e5865a3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:11.658591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fbc0ee45-fb0f-4e4a-9a69-f8f7e5865a3e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.166834 Jun 27 14:59:11.669617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 263/504] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:11 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:11.702474 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-24931e3f-3717-4fb3-bf3f-aeac56a8129a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:11.703045 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-24931e3f-3717-4fb3-bf3f-aeac56a8129a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:11.714262 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-24931e3f-3717-4fb3-bf3f-aeac56a8129a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:11.714708 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-24931e3f-3717-4fb3-bf3f-aeac56a8129a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:11.715675 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-24931e3f-3717-4fb3-bf3f-aeac56a8129a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:11.716107 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-24931e3f-3717-4fb3-bf3f-aeac56a8129a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:11.923437 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-24931e3f-3717-4fb3-bf3f-aeac56a8129a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:11.931050 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-24931e3f-3717-4fb3-bf3f-aeac56a8129a tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.233948 Jun 27 14:59:11.931740 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 242/505] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:11 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:12.151495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-455249fb-c47b-4157-b9b8-aae755355e6f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:12.152086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-455249fb-c47b-4157-b9b8-aae755355e6f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:12.158218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-455249fb-c47b-4157-b9b8-aae755355e6f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.158742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-455249fb-c47b-4157-b9b8-aae755355e6f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:12.159566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-455249fb-c47b-4157-b9b8-aae755355e6f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.160097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-455249fb-c47b-4157-b9b8-aae755355e6f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:12.185120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-455249fb-c47b-4157-b9b8-aae755355e6f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 14:59:12.410090 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-3e506eaf-2455-48d4-bcc7-5268872e37e6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:12.410742 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-3e506eaf-2455-48d4-bcc7-5268872e37e6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:12.417776 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3e506eaf-2455-48d4-bcc7-5268872e37e6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.418214 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3e506eaf-2455-48d4-bcc7-5268872e37e6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:12.418962 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3e506eaf-2455-48d4-bcc7-5268872e37e6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.419390 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-3e506eaf-2455-48d4-bcc7-5268872e37e6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:12.474252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-455249fb-c47b-4157-b9b8-aae755355e6f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 204 len: 0 microversion: 2.1 time: 0.326435 Jun 27 14:59:12.475053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 264/506] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 14:59:12 2022] DELETE /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 14:59:12.484469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-667e3a5a-4868-4b82-aac5-5be1f054c821 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:12.485863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-667e3a5a-4868-4b82-aac5-5be1f054c821 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:12.492460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-667e3a5a-4868-4b82-aac5-5be1f054c821 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.492460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-667e3a5a-4868-4b82-aac5-5be1f054c821 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:12.493309 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-667e3a5a-4868-4b82-aac5-5be1f054c821 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.493739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-667e3a5a-4868-4b82-aac5-5be1f054c821 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:12.558178 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-3e506eaf-2455-48d4-bcc7-5268872e37e6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:12.567479 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-3e506eaf-2455-48d4-bcc7-5268872e37e6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.161590 Jun 27 14:59:12.568442 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 243/507] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:12 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:12.632317 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-667e3a5a-4868-4b82-aac5-5be1f054c821 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:12.639606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-667e3a5a-4868-4b82-aac5-5be1f054c821 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.159705 Jun 27 14:59:12.640160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 265/508] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:12 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:12.675355 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-8dab236c-e44e-416d-a2e4-33c45b879dcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:12.676000 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-8dab236c-e44e-416d-a2e4-33c45b879dcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:12.682092 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8dab236c-e44e-416d-a2e4-33c45b879dcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.682544 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8dab236c-e44e-416d-a2e4-33c45b879dcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:12.683351 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8dab236c-e44e-416d-a2e4-33c45b879dcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.683723 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-8dab236c-e44e-416d-a2e4-33c45b879dcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:12.817244 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-8dab236c-e44e-416d-a2e4-33c45b879dcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:12.825006 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-8dab236c-e44e-416d-a2e4-33c45b879dcd tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.153637 Jun 27 14:59:12.825574 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 244/509] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:12 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:12.948950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0248b4ee-b11d-42cb-a999-6012841b9e77 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:12.949560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0248b4ee-b11d-42cb-a999-6012841b9e77 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:12.956046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0248b4ee-b11d-42cb-a999-6012841b9e77 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.960691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0248b4ee-b11d-42cb-a999-6012841b9e77 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:12.960691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0248b4ee-b11d-42cb-a999-6012841b9e77 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:12.960691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0248b4ee-b11d-42cb-a999-6012841b9e77 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:13.089944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0248b4ee-b11d-42cb-a999-6012841b9e77 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:13.098441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0248b4ee-b11d-42cb-a999-6012841b9e77 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.151969 Jun 27 14:59:13.098441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 266/510] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:12 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:13.585103 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-dd75c2fe-63d2-4098-a2e9-e3dd79ad7f1a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:13.585775 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-dd75c2fe-63d2-4098-a2e9-e3dd79ad7f1a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:13.592542 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-dd75c2fe-63d2-4098-a2e9-e3dd79ad7f1a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:13.593014 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-dd75c2fe-63d2-4098-a2e9-e3dd79ad7f1a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:13.593765 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-dd75c2fe-63d2-4098-a2e9-e3dd79ad7f1a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:13.594274 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-dd75c2fe-63d2-4098-a2e9-e3dd79ad7f1a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:13.660556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ef4a0ca9-9a1d-4362-b35a-29295b6d5c69 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:13.661417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ef4a0ca9-9a1d-4362-b35a-29295b6d5c69 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:13.668167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef4a0ca9-9a1d-4362-b35a-29295b6d5c69 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:13.669086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef4a0ca9-9a1d-4362-b35a-29295b6d5c69 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:13.669859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef4a0ca9-9a1d-4362-b35a-29295b6d5c69 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:13.670455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef4a0ca9-9a1d-4362-b35a-29295b6d5c69 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:13.738225 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-dd75c2fe-63d2-4098-a2e9-e3dd79ad7f1a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:13.745623 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-dd75c2fe-63d2-4098-a2e9-e3dd79ad7f1a tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.164520 Jun 27 14:59:13.746187 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 245/511] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:13 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:13.751204 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [req-68c4b260-1997-4447-b527-af0a3d5b9e2c req-63b1df29-08f2-4104-a615-3b931b4b4789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094071af-88ab-4d0b-b351-11aa81077ebd", "name": "network-vif-plugged", "status": "completed", "tag": "1c3fdae4-f9aa-4a9b-9036-d0ab24130b54"}]} {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:13.759898 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-68c4b260-1997-4447-b527-af0a3d5b9e2c req-63b1df29-08f2-4104-a615-3b931b4b4789 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:13.760370 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [req-68c4b260-1997-4447-b527-af0a3d5b9e2c req-63b1df29-08f2-4104-a615-3b931b4b4789 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:13.773355 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.compute.server_external_events [req-68c4b260-1997-4447-b527-af0a3d5b9e2c req-63b1df29-08f2-4104-a615-3b931b4b4789 service nova] Creating event network-vif-plugged:1c3fdae4-f9aa-4a9b-9036-d0ab24130b54 for instance 094071af-88ab-4d0b-b351-11aa81077ebd on hv-cinder-79760 Jun 27 14:59:13.778468 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [req-68c4b260-1997-4447-b527-af0a3d5b9e2c req-63b1df29-08f2-4104-a615-3b931b4b4789 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031189 Jun 27 14:59:13.779060 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 246/512] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:59:13.814584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ef4a0ca9-9a1d-4362-b35a-29295b6d5c69 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:13.823656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ef4a0ca9-9a1d-4362-b35a-29295b6d5c69 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.169665 Jun 27 14:59:13.824243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 267/513] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:13 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:13.845212 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-add918c0-1e09-4c52-a92e-763405d9bbbb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:13.845619 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-add918c0-1e09-4c52-a92e-763405d9bbbb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:13.851844 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-add918c0-1e09-4c52-a92e-763405d9bbbb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:13.852283 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-add918c0-1e09-4c52-a92e-763405d9bbbb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:13.853064 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-add918c0-1e09-4c52-a92e-763405d9bbbb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:13.853492 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-add918c0-1e09-4c52-a92e-763405d9bbbb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:13.982541 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-add918c0-1e09-4c52-a92e-763405d9bbbb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:13.990075 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-add918c0-1e09-4c52-a92e-763405d9bbbb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.150243 Jun 27 14:59:13.990570 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 247/514] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:13 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:14.114271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-557219c2-f44d-405d-aef0-c2927a1534d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:14.114879 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-557219c2-f44d-405d-aef0-c2927a1534d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:14.121058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-557219c2-f44d-405d-aef0-c2927a1534d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:14.127374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-557219c2-f44d-405d-aef0-c2927a1534d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:14.127374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-557219c2-f44d-405d-aef0-c2927a1534d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:14.127374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-557219c2-f44d-405d-aef0-c2927a1534d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:14.253308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-557219c2-f44d-405d-aef0-c2927a1534d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:14.260926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-557219c2-f44d-405d-aef0-c2927a1534d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.150989 Jun 27 14:59:14.261678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 268/515] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:14 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:14.762704 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-6c39a1eb-adda-44f2-b78f-2c834497f190 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:14.763304 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-6c39a1eb-adda-44f2-b78f-2c834497f190 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:14.769807 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c39a1eb-adda-44f2-b78f-2c834497f190 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:14.770254 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c39a1eb-adda-44f2-b78f-2c834497f190 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:14.771012 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c39a1eb-adda-44f2-b78f-2c834497f190 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:14.771435 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-6c39a1eb-adda-44f2-b78f-2c834497f190 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:14.840537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-69546e67-d899-4975-bdca-17ed65ac7409 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:14.841081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-69546e67-d899-4975-bdca-17ed65ac7409 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:14.847849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69546e67-d899-4975-bdca-17ed65ac7409 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:14.848293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69546e67-d899-4975-bdca-17ed65ac7409 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:14.850124 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69546e67-d899-4975-bdca-17ed65ac7409 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:14.850124 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69546e67-d899-4975-bdca-17ed65ac7409 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:14.904946 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-6c39a1eb-adda-44f2-b78f-2c834497f190 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:14.912655 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-6c39a1eb-adda-44f2-b78f-2c834497f190 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.153732 Jun 27 14:59:14.913332 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 248/516] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:14 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:14.983837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-69546e67-d899-4975-bdca-17ed65ac7409 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:14.991844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-69546e67-d899-4975-bdca-17ed65ac7409 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.155214 Jun 27 14:59:14.992407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 269/517] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:14 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:15.007160 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-9076385e-3ebf-4868-ba43-b88fb7ec0b87 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:15.007762 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-9076385e-3ebf-4868-ba43-b88fb7ec0b87 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:15.013672 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9076385e-3ebf-4868-ba43-b88fb7ec0b87 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:15.014156 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9076385e-3ebf-4868-ba43-b88fb7ec0b87 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:15.014910 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9076385e-3ebf-4868-ba43-b88fb7ec0b87 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:15.015346 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-9076385e-3ebf-4868-ba43-b88fb7ec0b87 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:15.143340 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-9076385e-3ebf-4868-ba43-b88fb7ec0b87 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:15.150781 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-9076385e-3ebf-4868-ba43-b88fb7ec0b87 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1511 microversion: 2.1 time: 0.147450 Jun 27 14:59:15.151334 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 249/518] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:15 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:15.276624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1b1840d0-3a7f-4ce0-8b9a-6f7a2fae0ebd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:15.277255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1b1840d0-3a7f-4ce0-8b9a-6f7a2fae0ebd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:15.283801 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1b1840d0-3a7f-4ce0-8b9a-6f7a2fae0ebd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:15.284241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1b1840d0-3a7f-4ce0-8b9a-6f7a2fae0ebd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:15.285033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1b1840d0-3a7f-4ce0-8b9a-6f7a2fae0ebd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:15.285468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1b1840d0-3a7f-4ce0-8b9a-6f7a2fae0ebd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:15.412006 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1b1840d0-3a7f-4ce0-8b9a-6f7a2fae0ebd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:15.419340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1b1840d0-3a7f-4ce0-8b9a-6f7a2fae0ebd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.146519 Jun 27 14:59:15.419894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 270/519] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:15 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:15.930854 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-86c1e51c-028d-4976-9ffa-a146765ae3c6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:15.931456 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-86c1e51c-028d-4976-9ffa-a146765ae3c6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:15.938559 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86c1e51c-028d-4976-9ffa-a146765ae3c6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:15.939012 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86c1e51c-028d-4976-9ffa-a146765ae3c6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:15.939769 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86c1e51c-028d-4976-9ffa-a146765ae3c6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:15.940319 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-86c1e51c-028d-4976-9ffa-a146765ae3c6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:16.009306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f86b1ed7-89f6-4fa5-92fa-4049782c33f2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:16.010140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f86b1ed7-89f6-4fa5-92fa-4049782c33f2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:16.016827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f86b1ed7-89f6-4fa5-92fa-4049782c33f2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:16.017336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f86b1ed7-89f6-4fa5-92fa-4049782c33f2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:16.018278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f86b1ed7-89f6-4fa5-92fa-4049782c33f2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:16.018775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f86b1ed7-89f6-4fa5-92fa-4049782c33f2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:16.073386 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.policy [None req-86c1e51c-028d-4976-9ffa-a146765ae3c6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:16.081821 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: INFO nova.api.openstack.requestlog [None req-86c1e51c-028d-4976-9ffa-a146765ae3c6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.155062 Jun 27 14:59:16.082415 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: [pid: 129686|app: 0|req: 250/520] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:15 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:16.151433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f86b1ed7-89f6-4fa5-92fa-4049782c33f2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:16.158986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f86b1ed7-89f6-4fa5-92fa-4049782c33f2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.153581 Jun 27 14:59:16.159589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 271/521] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:16 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:16.167329 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.api.openstack.wsgi [None req-b00ebf80-dc87-42a2-a2b1-678f29345f3b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:16.167934 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG nova.compute.api [None req-b00ebf80-dc87-42a2-a2b1-678f29345f3b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:16.174401 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b00ebf80-dc87-42a2-a2b1-678f29345f3b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:16.174842 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b00ebf80-dc87-42a2-a2b1-678f29345f3b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:16.175601 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: DEBUG oslo_concurrency.lockutils [None req-b00ebf80-dc87-42a2-a2b1-678f29345f3b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:16.194777 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: Traceback (most recent call last): Jun 27 14:59:16.194935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 27 14:59:16.194935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: timer() Jun 27 14:59:16.194935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 27 14:59:16.194935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: cb(*args, **kw) Jun 27 14:59:16.194935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jun 27 14:59:16.194935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: waiter.switch() Jun 27 14:59:16.194935 dv-cinder-797608-35-iscsi devstack@n-api.service[129686]: greenlet.error: cannot switch to a different thread Jun 27 14:59:16.436897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-479a343a-d86d-4841-8760-5d2660b5e7ee tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:16.437406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-479a343a-d86d-4841-8760-5d2660b5e7ee tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:16.444026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-479a343a-d86d-4841-8760-5d2660b5e7ee tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:16.444574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-479a343a-d86d-4841-8760-5d2660b5e7ee tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:16.445437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-479a343a-d86d-4841-8760-5d2660b5e7ee tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:16.445862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-479a343a-d86d-4841-8760-5d2660b5e7ee tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:16.578351 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-479a343a-d86d-4841-8760-5d2660b5e7ee tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:16.586274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-479a343a-d86d-4841-8760-5d2660b5e7ee tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.153396 Jun 27 14:59:16.586827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 272/522] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:16 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:17.099060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-48dcd18e-ca01-4d92-a630-ba79d364b2b6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:17.099653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-48dcd18e-ca01-4d92-a630-ba79d364b2b6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:17.106978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-48dcd18e-ca01-4d92-a630-ba79d364b2b6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:17.107416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-48dcd18e-ca01-4d92-a630-ba79d364b2b6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:17.108262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-48dcd18e-ca01-4d92-a630-ba79d364b2b6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:17.108609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-48dcd18e-ca01-4d92-a630-ba79d364b2b6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:17.237759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-48dcd18e-ca01-4d92-a630-ba79d364b2b6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:17.243713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-48dcd18e-ca01-4d92-a630-ba79d364b2b6 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.149014 Jun 27 14:59:17.244265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 273/523] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:17 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:17.248594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5d0b1172-33fc-4b66-85f1-8f54fe7e4b31 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:17.249209 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5d0b1172-33fc-4b66-85f1-8f54fe7e4b31 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:17.254818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d0b1172-33fc-4b66-85f1-8f54fe7e4b31 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:17.255254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d0b1172-33fc-4b66-85f1-8f54fe7e4b31 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:17.256001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d0b1172-33fc-4b66-85f1-8f54fe7e4b31 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:17.256459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d0b1172-33fc-4b66-85f1-8f54fe7e4b31 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:17.392563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5d0b1172-33fc-4b66-85f1-8f54fe7e4b31 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:17.399888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5d0b1172-33fc-4b66-85f1-8f54fe7e4b31 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.154665 Jun 27 14:59:17.400486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 274/524] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:17 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:17.603188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3acc90c2-2ad1-4fb4-9c9e-378f7056307c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:17.603780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3acc90c2-2ad1-4fb4-9c9e-378f7056307c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:17.609743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3acc90c2-2ad1-4fb4-9c9e-378f7056307c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:17.610194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3acc90c2-2ad1-4fb4-9c9e-378f7056307c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:17.611044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3acc90c2-2ad1-4fb4-9c9e-378f7056307c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:17.611470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3acc90c2-2ad1-4fb4-9c9e-378f7056307c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:17.749194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3acc90c2-2ad1-4fb4-9c9e-378f7056307c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:17.753230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:17.757654 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3acc90c2-2ad1-4fb4-9c9e-378f7056307c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.158542 Jun 27 14:59:17.758218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 275/525] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:17 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:18.260944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-edfefedc-0f33-47f1-9939-914fbf139e84 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:18.261541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-edfefedc-0f33-47f1-9939-914fbf139e84 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:18.268037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-edfefedc-0f33-47f1-9939-914fbf139e84 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:18.268472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-edfefedc-0f33-47f1-9939-914fbf139e84 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:18.269235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-edfefedc-0f33-47f1-9939-914fbf139e84 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:18.269660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-edfefedc-0f33-47f1-9939-914fbf139e84 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:18.397763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-edfefedc-0f33-47f1-9939-914fbf139e84 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:18.405005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-edfefedc-0f33-47f1-9939-914fbf139e84 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.148218 Jun 27 14:59:18.405629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 276/526] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:18 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:18.416886 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1c7d7919-2273-46a5-8244-d36c248d6116 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:18.417521 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1c7d7919-2273-46a5-8244-d36c248d6116 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:18.423745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1c7d7919-2273-46a5-8244-d36c248d6116 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:18.424173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1c7d7919-2273-46a5-8244-d36c248d6116 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:18.424941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1c7d7919-2273-46a5-8244-d36c248d6116 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:18.425367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1c7d7919-2273-46a5-8244-d36c248d6116 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:18.552543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1c7d7919-2273-46a5-8244-d36c248d6116 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:18.559841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1c7d7919-2273-46a5-8244-d36c248d6116 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.146430 Jun 27 14:59:18.560393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 277/527] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:18 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:18.774860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a79eeac0-0fb8-4541-96a3-e226c2c228ff tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:18.775464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a79eeac0-0fb8-4541-96a3-e226c2c228ff tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:18.781377 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a79eeac0-0fb8-4541-96a3-e226c2c228ff tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:18.782451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a79eeac0-0fb8-4541-96a3-e226c2c228ff tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:18.783215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a79eeac0-0fb8-4541-96a3-e226c2c228ff tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:18.783641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a79eeac0-0fb8-4541-96a3-e226c2c228ff tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:18.908947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a79eeac0-0fb8-4541-96a3-e226c2c228ff tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:18.916459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a79eeac0-0fb8-4541-96a3-e226c2c228ff tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.145312 Jun 27 14:59:18.916992 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 278/528] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:18 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:19.422749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1a8fbf3d-19bb-40e6-9293-ea4b4f846af3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:19.423339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1a8fbf3d-19bb-40e6-9293-ea4b4f846af3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:19.429646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a8fbf3d-19bb-40e6-9293-ea4b4f846af3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:19.430088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a8fbf3d-19bb-40e6-9293-ea4b4f846af3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:19.431083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a8fbf3d-19bb-40e6-9293-ea4b4f846af3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:19.431514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a8fbf3d-19bb-40e6-9293-ea4b4f846af3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:19.561192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1a8fbf3d-19bb-40e6-9293-ea4b4f846af3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:19.569234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1a8fbf3d-19bb-40e6-9293-ea4b4f846af3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.150801 Jun 27 14:59:19.570035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 279/529] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:19 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:19.575905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-42f09cb5-023f-44b6-836a-a4053fede231 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:19.576496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-42f09cb5-023f-44b6-836a-a4053fede231 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:19.582354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-42f09cb5-023f-44b6-836a-a4053fede231 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:19.582789 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-42f09cb5-023f-44b6-836a-a4053fede231 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:19.583524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-42f09cb5-023f-44b6-836a-a4053fede231 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:19.583950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-42f09cb5-023f-44b6-836a-a4053fede231 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:19.711139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-42f09cb5-023f-44b6-836a-a4053fede231 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:19.718569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-42f09cb5-023f-44b6-836a-a4053fede231 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.146096 Jun 27 14:59:19.719699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 280/530] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:19 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:19.933168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b74c475d-9841-4f31-8ab9-7ffbcf705839 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:19.933781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b74c475d-9841-4f31-8ab9-7ffbcf705839 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:19.940032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b74c475d-9841-4f31-8ab9-7ffbcf705839 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:19.940476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b74c475d-9841-4f31-8ab9-7ffbcf705839 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:19.941251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b74c475d-9841-4f31-8ab9-7ffbcf705839 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:19.941679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b74c475d-9841-4f31-8ab9-7ffbcf705839 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:20.071766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b74c475d-9841-4f31-8ab9-7ffbcf705839 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:20.079711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b74c475d-9841-4f31-8ab9-7ffbcf705839 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.150374 Jun 27 14:59:20.080264 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 281/531] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:19 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:20.586640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-429fac23-4297-4d56-a3f7-bc7557f7003e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:20.587273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-429fac23-4297-4d56-a3f7-bc7557f7003e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:20.593245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-429fac23-4297-4d56-a3f7-bc7557f7003e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:20.593688 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-429fac23-4297-4d56-a3f7-bc7557f7003e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:20.594572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-429fac23-4297-4d56-a3f7-bc7557f7003e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:20.594999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-429fac23-4297-4d56-a3f7-bc7557f7003e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:20.720336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-429fac23-4297-4d56-a3f7-bc7557f7003e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:20.727728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-429fac23-4297-4d56-a3f7-bc7557f7003e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.145470 Jun 27 14:59:20.728301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 282/532] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:20 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:20.735518 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-38782aca-3a46-4610-9b86-a85d26a842cd tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:20.736198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-38782aca-3a46-4610-9b86-a85d26a842cd tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:20.742111 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-38782aca-3a46-4610-9b86-a85d26a842cd tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:20.742553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-38782aca-3a46-4610-9b86-a85d26a842cd tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:20.743302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-38782aca-3a46-4610-9b86-a85d26a842cd tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:20.743758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-38782aca-3a46-4610-9b86-a85d26a842cd tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:20.874348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-38782aca-3a46-4610-9b86-a85d26a842cd tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:20.882388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-38782aca-3a46-4610-9b86-a85d26a842cd tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.150680 Jun 27 14:59:20.882937 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 283/533] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:20 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:21.096878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9bea3cca-17f6-47b4-85b1-45a2594f87a9 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:21.097504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9bea3cca-17f6-47b4-85b1-45a2594f87a9 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:21.103432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9bea3cca-17f6-47b4-85b1-45a2594f87a9 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:21.103943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9bea3cca-17f6-47b4-85b1-45a2594f87a9 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:21.104736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9bea3cca-17f6-47b4-85b1-45a2594f87a9 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:21.105173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9bea3cca-17f6-47b4-85b1-45a2594f87a9 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:21.231625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9bea3cca-17f6-47b4-85b1-45a2594f87a9 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:21.239580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9bea3cca-17f6-47b4-85b1-45a2594f87a9 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.147105 Jun 27 14:59:21.240139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 284/534] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:21 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:21.744621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b281b2ed-04fe-41b3-9994-04d53e72d066 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:21.745275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b281b2ed-04fe-41b3-9994-04d53e72d066 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:21.751160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b281b2ed-04fe-41b3-9994-04d53e72d066 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:21.751600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b281b2ed-04fe-41b3-9994-04d53e72d066 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:21.752350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b281b2ed-04fe-41b3-9994-04d53e72d066 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:21.752806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b281b2ed-04fe-41b3-9994-04d53e72d066 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:21.878541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b281b2ed-04fe-41b3-9994-04d53e72d066 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:21.885879 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b281b2ed-04fe-41b3-9994-04d53e72d066 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.144964 Jun 27 14:59:21.886608 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 285/535] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:21 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:21.898071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4f97df03-d765-44f9-9c94-657e313d5270 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:21.898675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4f97df03-d765-44f9-9c94-657e313d5270 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:21.904683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f97df03-d765-44f9-9c94-657e313d5270 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:21.905188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f97df03-d765-44f9-9c94-657e313d5270 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:21.905879 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f97df03-d765-44f9-9c94-657e313d5270 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:21.906320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f97df03-d765-44f9-9c94-657e313d5270 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:22.038778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4f97df03-d765-44f9-9c94-657e313d5270 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:22.046123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4f97df03-d765-44f9-9c94-657e313d5270 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.151809 Jun 27 14:59:22.046688 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 286/536] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:21 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:22.255879 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6ff3c44c-12de-427d-900c-3e1d482a898d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:22.256597 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6ff3c44c-12de-427d-900c-3e1d482a898d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:22.262474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ff3c44c-12de-427d-900c-3e1d482a898d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:22.262912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ff3c44c-12de-427d-900c-3e1d482a898d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:22.263656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ff3c44c-12de-427d-900c-3e1d482a898d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:22.264079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ff3c44c-12de-427d-900c-3e1d482a898d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:22.394579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6ff3c44c-12de-427d-900c-3e1d482a898d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:22.402053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6ff3c44c-12de-427d-900c-3e1d482a898d tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.150033 Jun 27 14:59:22.402599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 287/537] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:22 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:22.903485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b13a7aa2-3f67-45f9-8483-a13e21dcdc63 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:22.904095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b13a7aa2-3f67-45f9-8483-a13e21dcdc63 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:22.911046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b13a7aa2-3f67-45f9-8483-a13e21dcdc63 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:22.911494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b13a7aa2-3f67-45f9-8483-a13e21dcdc63 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:22.912385 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b13a7aa2-3f67-45f9-8483-a13e21dcdc63 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:22.912852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b13a7aa2-3f67-45f9-8483-a13e21dcdc63 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:23.049524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b13a7aa2-3f67-45f9-8483-a13e21dcdc63 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:23.057193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b13a7aa2-3f67-45f9-8483-a13e21dcdc63 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.157545 Jun 27 14:59:23.057870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 288/538] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:22 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:23.062617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-700799741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-171805540", "security_groups": [{"name": "tempest-secgroup-smoke-1158523129"}], "networks": [{"uuid": "b361cdec-567f-4875-b806-fe078abf356b"}], "block_device_mapping_v2": [{"uuid": "78bd334d-19f9-45d2-8464-23e87350d6cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:23.211064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] validate_networks() for [('b361cdec-567f-4875-b806-fe078abf356b', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:59:23.581122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:59:23.584577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:59:23.584577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:59:23.584577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:59:23.584577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:59:23.591550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:23.591986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:23.592811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:23.593240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:23.610930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Getting quotas for project 253d5ed8735d445c930140b6d91136c8. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:59:23.616836 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Getting quotas for user 4f764a725deb405198f95d583035b371 and project 253d5ed8735d445c930140b6d91136c8. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:59:23.671538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:59:23.674324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78bd334d-19f9-45d2-8464-23e87350d6cc',volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:59:24.052291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-90af8bc9-956c-406b-ad4a-775836e9f7d4 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.993390 Jun 27 14:59:24.052964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 289/539] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:59:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 14:59:24.057481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9ff7c57f-4241-4105-9ab0-e4c50a390f3e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:24.058662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9ff7c57f-4241-4105-9ab0-e4c50a390f3e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:24.065335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ff7c57f-4241-4105-9ab0-e4c50a390f3e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:24.068188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ff7c57f-4241-4105-9ab0-e4c50a390f3e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:24.068188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ff7c57f-4241-4105-9ab0-e4c50a390f3e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:24.068188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ff7c57f-4241-4105-9ab0-e4c50a390f3e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:24.204521 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9ff7c57f-4241-4105-9ab0-e4c50a390f3e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:24.214009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9ff7c57f-4241-4105-9ab0-e4c50a390f3e tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.160019 Jun 27 14:59:24.214611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 290/540] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:24 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:24.220090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e7e3af40-75de-4c8b-ba90-76c5ff5f47cb tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:24.228720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e7e3af40-75de-4c8b-ba90-76c5ff5f47cb tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:24.228720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e7e3af40-75de-4c8b-ba90-76c5ff5f47cb tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:24.228720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e7e3af40-75de-4c8b-ba90-76c5ff5f47cb tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:24.228720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e7e3af40-75de-4c8b-ba90-76c5ff5f47cb tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:24.229297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e7e3af40-75de-4c8b-ba90-76c5ff5f47cb tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:24.362706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e7e3af40-75de-4c8b-ba90-76c5ff5f47cb tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:24.370142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e7e3af40-75de-4c8b-ba90-76c5ff5f47cb tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.154571 Jun 27 14:59:24.370694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 291/541] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:24 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:24.376431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-11727783-f2e6-45da-a250-15faaba9879e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:24.377155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-11727783-f2e6-45da-a250-15faaba9879e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:24.428298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-11727783-f2e6-45da-a250-15faaba9879e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:24.435262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-11727783-f2e6-45da-a250-15faaba9879e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1087 microversion: 2.1 time: 0.063565 Jun 27 14:59:24.435815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 292/542] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:24 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1087 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:24.441179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-24d0fda0-7718-4888-872b-ede1e5a3f848 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:24.441774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-24d0fda0-7718-4888-872b-ede1e5a3f848 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:24.447363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24d0fda0-7718-4888-872b-ede1e5a3f848 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:24.447808 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24d0fda0-7718-4888-872b-ede1e5a3f848 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:24.448554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24d0fda0-7718-4888-872b-ede1e5a3f848 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:24.448996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24d0fda0-7718-4888-872b-ede1e5a3f848 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:24.579744 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-24d0fda0-7718-4888-872b-ede1e5a3f848 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:24.587170 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-24d0fda0-7718-4888-872b-ede1e5a3f848 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.150411 Jun 27 14:59:24.593687 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 293/543] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:24 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:25.231524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e9fa2908-4ea1-4d0e-acd1-ce57ae3459d0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:25.232224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e9fa2908-4ea1-4d0e-acd1-ce57ae3459d0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:25.238502 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9fa2908-4ea1-4d0e-acd1-ce57ae3459d0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:25.238942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9fa2908-4ea1-4d0e-acd1-ce57ae3459d0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:25.239725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9fa2908-4ea1-4d0e-acd1-ce57ae3459d0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:25.240098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9fa2908-4ea1-4d0e-acd1-ce57ae3459d0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:25.244110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:25.369843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e9fa2908-4ea1-4d0e-acd1-ce57ae3459d0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:25.377889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e9fa2908-4ea1-4d0e-acd1-ce57ae3459d0 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.150173 Jun 27 14:59:25.378441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 294/544] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:25 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:25.386619 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-77a93fef-5b1f-45e6-aca5-8e9220d324c8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:25.387206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-77a93fef-5b1f-45e6-aca5-8e9220d324c8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:25.393220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-77a93fef-5b1f-45e6-aca5-8e9220d324c8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:25.393656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-77a93fef-5b1f-45e6-aca5-8e9220d324c8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:25.394396 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-77a93fef-5b1f-45e6-aca5-8e9220d324c8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:25.394817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-77a93fef-5b1f-45e6-aca5-8e9220d324c8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:25.519601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-77a93fef-5b1f-45e6-aca5-8e9220d324c8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:25.527263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-77a93fef-5b1f-45e6-aca5-8e9220d324c8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.144102 Jun 27 14:59:25.527822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 295/545] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:25 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:25.532219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8602f13e-07d4-4d27-96ba-66f88a95c418 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:25.532848 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8602f13e-07d4-4d27-96ba-66f88a95c418 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:25.538457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8602f13e-07d4-4d27-96ba-66f88a95c418 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:25.538887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8602f13e-07d4-4d27-96ba-66f88a95c418 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:25.539644 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8602f13e-07d4-4d27-96ba-66f88a95c418 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:25.540075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8602f13e-07d4-4d27-96ba-66f88a95c418 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:25.598688 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8602f13e-07d4-4d27-96ba-66f88a95c418 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:25.606079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8602f13e-07d4-4d27-96ba-66f88a95c418 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1137 microversion: 2.1 time: 0.077319 Jun 27 14:59:25.606644 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 296/546] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:25 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1137 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:25.611573 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f53981e0-8272-40a3-813c-9ca109b034f0 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:25.612165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f53981e0-8272-40a3-813c-9ca109b034f0 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:25.617727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f53981e0-8272-40a3-813c-9ca109b034f0 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:25.618113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f53981e0-8272-40a3-813c-9ca109b034f0 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:25.618864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f53981e0-8272-40a3-813c-9ca109b034f0 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:25.619295 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f53981e0-8272-40a3-813c-9ca109b034f0 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:25.749746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f53981e0-8272-40a3-813c-9ca109b034f0 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:25.757154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f53981e0-8272-40a3-813c-9ca109b034f0 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.149502 Jun 27 14:59:25.758047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 297/547] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:25 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:25.919566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-35bc0970-38c8-4a33-9e80-164bea743bdf req-e0448ce5-96aa-47df-8e46-dc06744b9b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e0606f-8bab-4c30-ae7e-82708c23e054", "name": "network-vif-plugged", "status": "completed", "tag": "5d2059ae-f1b6-46f6-b474-af4d48ffa6ee"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:25.928803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-35bc0970-38c8-4a33-9e80-164bea743bdf req-e0448ce5-96aa-47df-8e46-dc06744b9b5d service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:25.929243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-35bc0970-38c8-4a33-9e80-164bea743bdf req-e0448ce5-96aa-47df-8e46-dc06744b9b5d service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:25.940004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-35bc0970-38c8-4a33-9e80-164bea743bdf req-e0448ce5-96aa-47df-8e46-dc06744b9b5d service nova] Creating event network-vif-plugged:5d2059ae-f1b6-46f6-b474-af4d48ffa6ee for instance 78e0606f-8bab-4c30-ae7e-82708c23e054 on hv-cinder-79760 Jun 27 14:59:25.945077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-35bc0970-38c8-4a33-9e80-164bea743bdf req-e0448ce5-96aa-47df-8e46-dc06744b9b5d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029253 Jun 27 14:59:25.945838 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 298/548] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:59:26.395660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4549da46-12c7-4319-bba3-26c1abf3a510 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:26.396345 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4549da46-12c7-4319-bba3-26c1abf3a510 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:26.398424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:26.403467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4549da46-12c7-4319-bba3-26c1abf3a510 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:26.403970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4549da46-12c7-4319-bba3-26c1abf3a510 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:26.404742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4549da46-12c7-4319-bba3-26c1abf3a510 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:26.405164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4549da46-12c7-4319-bba3-26c1abf3a510 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:26.535159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4549da46-12c7-4319-bba3-26c1abf3a510 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:26.542803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4549da46-12c7-4319-bba3-26c1abf3a510 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.152100 Jun 27 14:59:26.543374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 299/549] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:26 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:26.547941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5cbe5e3d-4db0-474b-a8ed-d21fc5ae6c39 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:26.548535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5cbe5e3d-4db0-474b-a8ed-d21fc5ae6c39 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:26.554097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5cbe5e3d-4db0-474b-a8ed-d21fc5ae6c39 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:26.554539 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5cbe5e3d-4db0-474b-a8ed-d21fc5ae6c39 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:26.555372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5cbe5e3d-4db0-474b-a8ed-d21fc5ae6c39 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:26.555777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5cbe5e3d-4db0-474b-a8ed-d21fc5ae6c39 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:26.686330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5cbe5e3d-4db0-474b-a8ed-d21fc5ae6c39 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:26.694753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5cbe5e3d-4db0-474b-a8ed-d21fc5ae6c39 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.150357 Jun 27 14:59:26.695307 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 300/550] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:26 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:26.699624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4a3de49d-b584-4aaf-9705-b85228e9ac5c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:26.700217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4a3de49d-b584-4aaf-9705-b85228e9ac5c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:26.706261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4a3de49d-b584-4aaf-9705-b85228e9ac5c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:26.706701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4a3de49d-b584-4aaf-9705-b85228e9ac5c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:26.707454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4a3de49d-b584-4aaf-9705-b85228e9ac5c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:26.707883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4a3de49d-b584-4aaf-9705-b85228e9ac5c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:26.766874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4a3de49d-b584-4aaf-9705-b85228e9ac5c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:26.774200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4a3de49d-b584-4aaf-9705-b85228e9ac5c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1137 microversion: 2.1 time: 0.077945 Jun 27 14:59:26.774769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 301/551] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:26 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1137 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:26.779171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-60cc37c7-485b-4d34-8edf-a8849ae6706c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:26.779771 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-60cc37c7-485b-4d34-8edf-a8849ae6706c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:26.785741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60cc37c7-485b-4d34-8edf-a8849ae6706c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:26.786109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60cc37c7-485b-4d34-8edf-a8849ae6706c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:26.786862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60cc37c7-485b-4d34-8edf-a8849ae6706c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:26.787294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60cc37c7-485b-4d34-8edf-a8849ae6706c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:26.912763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-60cc37c7-485b-4d34-8edf-a8849ae6706c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:26.920107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-60cc37c7-485b-4d34-8edf-a8849ae6706c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.144410 Jun 27 14:59:26.924768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 302/552] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:26 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:27.559322 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2e5ad3ea-1c73-4553-ba3d-28d80fccda22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:27.559917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2e5ad3ea-1c73-4553-ba3d-28d80fccda22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:27.566731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e5ad3ea-1c73-4553-ba3d-28d80fccda22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:27.567168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e5ad3ea-1c73-4553-ba3d-28d80fccda22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:27.567905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e5ad3ea-1c73-4553-ba3d-28d80fccda22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:27.568329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2e5ad3ea-1c73-4553-ba3d-28d80fccda22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:27.696402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2e5ad3ea-1c73-4553-ba3d-28d80fccda22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:27.703766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2e5ad3ea-1c73-4553-ba3d-28d80fccda22 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.148263 Jun 27 14:59:27.704318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 303/553] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:27 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:27.711936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a244e0d-8712-4afd-a94c-00124831d6df tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:27.712525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5a244e0d-8712-4afd-a94c-00124831d6df tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:27.718156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a244e0d-8712-4afd-a94c-00124831d6df tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:27.718589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a244e0d-8712-4afd-a94c-00124831d6df tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:27.719361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a244e0d-8712-4afd-a94c-00124831d6df tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:27.719782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a244e0d-8712-4afd-a94c-00124831d6df tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:27.844313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5a244e0d-8712-4afd-a94c-00124831d6df tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:27.851546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5a244e0d-8712-4afd-a94c-00124831d6df tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.143098 Jun 27 14:59:27.852096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 304/554] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:27 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:27.856388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-08f7dbd4-8d01-451b-918e-d7ba4786a44d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:27.857003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-08f7dbd4-8d01-451b-918e-d7ba4786a44d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:27.863038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd4-8d01-451b-918e-d7ba4786a44d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:27.863476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd4-8d01-451b-918e-d7ba4786a44d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:27.864219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd4-8d01-451b-918e-d7ba4786a44d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:27.864661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08f7dbd4-8d01-451b-918e-d7ba4786a44d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:27.922803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-08f7dbd4-8d01-451b-918e-d7ba4786a44d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:27.931043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-08f7dbd4-8d01-451b-918e-d7ba4786a44d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1137 microversion: 2.1 time: 0.077983 Jun 27 14:59:27.931786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 305/555] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:27 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1137 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:27.939519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7750c76a-af03-4768-9855-51c7ad05c375 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:27.940253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7750c76a-af03-4768-9855-51c7ad05c375 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:27.946371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7750c76a-af03-4768-9855-51c7ad05c375 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:27.946820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7750c76a-af03-4768-9855-51c7ad05c375 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:27.947590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7750c76a-af03-4768-9855-51c7ad05c375 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:27.948024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7750c76a-af03-4768-9855-51c7ad05c375 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:28.077972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7750c76a-af03-4768-9855-51c7ad05c375 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:28.085699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7750c76a-af03-4768-9855-51c7ad05c375 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.151165 Jun 27 14:59:28.086258 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 306/556] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:27 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:28.721660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-09264986-9f61-43e8-83b5-3c97f90cbf81 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:28.722276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-09264986-9f61-43e8-83b5-3c97f90cbf81 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:28.728299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-09264986-9f61-43e8-83b5-3c97f90cbf81 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:28.728788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-09264986-9f61-43e8-83b5-3c97f90cbf81 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:28.729543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-09264986-9f61-43e8-83b5-3c97f90cbf81 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:28.729976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-09264986-9f61-43e8-83b5-3c97f90cbf81 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:28.855483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-09264986-9f61-43e8-83b5-3c97f90cbf81 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:28.862986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-09264986-9f61-43e8-83b5-3c97f90cbf81 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.146175 Jun 27 14:59:28.863547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 307/557] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:28 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:28.867944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4406572c-385f-4819-b60a-e489f2be71d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:28.868535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4406572c-385f-4819-b60a-e489f2be71d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:28.874185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4406572c-385f-4819-b60a-e489f2be71d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:28.874628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4406572c-385f-4819-b60a-e489f2be71d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:28.876178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4406572c-385f-4819-b60a-e489f2be71d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:28.876608 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4406572c-385f-4819-b60a-e489f2be71d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:29.010463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4406572c-385f-4819-b60a-e489f2be71d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:29.018655 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4406572c-385f-4819-b60a-e489f2be71d5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.154065 Jun 27 14:59:29.019220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 308/558] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:28 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:29.023698 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c1ada280-d730-472b-a673-5cfc3e12407e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:29.024180 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c1ada280-d730-472b-a673-5cfc3e12407e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:29.030406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1ada280-d730-472b-a673-5cfc3e12407e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:29.030844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1ada280-d730-472b-a673-5cfc3e12407e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:29.031988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1ada280-d730-472b-a673-5cfc3e12407e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:29.032198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1ada280-d730-472b-a673-5cfc3e12407e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:29.093869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c1ada280-d730-472b-a673-5cfc3e12407e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:29.101589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c1ada280-d730-472b-a673-5cfc3e12407e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1137 microversion: 2.1 time: 0.081384 Jun 27 14:59:29.102158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 309/559] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:29 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:29.106630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-07bcf6db-31c0-4ea2-95e4-83de8e08890f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:29.107217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-07bcf6db-31c0-4ea2-95e4-83de8e08890f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:29.113699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-07bcf6db-31c0-4ea2-95e4-83de8e08890f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:29.114140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-07bcf6db-31c0-4ea2-95e4-83de8e08890f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:29.114908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-07bcf6db-31c0-4ea2-95e4-83de8e08890f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:29.115329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-07bcf6db-31c0-4ea2-95e4-83de8e08890f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:29.240342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-07bcf6db-31c0-4ea2-95e4-83de8e08890f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:29.247657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-07bcf6db-31c0-4ea2-95e4-83de8e08890f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.144566 Jun 27 14:59:29.248223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 310/560] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:29 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:29.879361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f873f433-82f2-40d3-92be-ae5a219b8210 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:29.879969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f873f433-82f2-40d3-92be-ae5a219b8210 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:29.885849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f873f433-82f2-40d3-92be-ae5a219b8210 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:29.886292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f873f433-82f2-40d3-92be-ae5a219b8210 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:29.887047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f873f433-82f2-40d3-92be-ae5a219b8210 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:29.887475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f873f433-82f2-40d3-92be-ae5a219b8210 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:29.905508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:30.018473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f873f433-82f2-40d3-92be-ae5a219b8210 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:30.025992 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f873f433-82f2-40d3-92be-ae5a219b8210 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.150640 Jun 27 14:59:30.026551 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 311/561] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:29 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:30.035917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c14fea24-9222-4cf4-ac98-84306193e660 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:30.036527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c14fea24-9222-4cf4-ac98-84306193e660 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:30.042295 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c14fea24-9222-4cf4-ac98-84306193e660 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:30.042738 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c14fea24-9222-4cf4-ac98-84306193e660 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:30.043469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c14fea24-9222-4cf4-ac98-84306193e660 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:30.043895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c14fea24-9222-4cf4-ac98-84306193e660 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:30.172265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c14fea24-9222-4cf4-ac98-84306193e660 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:30.179628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c14fea24-9222-4cf4-ac98-84306193e660 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.148416 Jun 27 14:59:30.180185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 312/562] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:30 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:30.184504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cf8d72e1-86c7-4325-9e79-b5ce7aa9ae90 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:30.185121 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cf8d72e1-86c7-4325-9e79-b5ce7aa9ae90 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:30.191026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf8d72e1-86c7-4325-9e79-b5ce7aa9ae90 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:30.191468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf8d72e1-86c7-4325-9e79-b5ce7aa9ae90 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:30.192215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf8d72e1-86c7-4325-9e79-b5ce7aa9ae90 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:30.192657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf8d72e1-86c7-4325-9e79-b5ce7aa9ae90 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:30.252150 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cf8d72e1-86c7-4325-9e79-b5ce7aa9ae90 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:30.259704 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cf8d72e1-86c7-4325-9e79-b5ce7aa9ae90 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1129 microversion: 2.1 time: 0.078518 Jun 27 14:59:30.260263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 313/563] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:30 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1129 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:30.264718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8d62b160-550d-4a8c-b696-9dc2cbe9ffdd tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:30.265315 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8d62b160-550d-4a8c-b696-9dc2cbe9ffdd tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:30.271564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d62b160-550d-4a8c-b696-9dc2cbe9ffdd tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:30.271999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d62b160-550d-4a8c-b696-9dc2cbe9ffdd tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:30.272787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d62b160-550d-4a8c-b696-9dc2cbe9ffdd tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:30.277874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d62b160-550d-4a8c-b696-9dc2cbe9ffdd tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:30.403315 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8d62b160-550d-4a8c-b696-9dc2cbe9ffdd tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:30.411202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8d62b160-550d-4a8c-b696-9dc2cbe9ffdd tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.149972 Jun 27 14:59:30.411756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 314/564] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:30 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:31.043424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fe832988-e8eb-45d4-ad70-f6b87277c15f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:31.044103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fe832988-e8eb-45d4-ad70-f6b87277c15f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:31.050094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe832988-e8eb-45d4-ad70-f6b87277c15f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:31.050529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe832988-e8eb-45d4-ad70-f6b87277c15f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:31.051272 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe832988-e8eb-45d4-ad70-f6b87277c15f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:31.051696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe832988-e8eb-45d4-ad70-f6b87277c15f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:31.178692 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fe832988-e8eb-45d4-ad70-f6b87277c15f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:31.186147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fe832988-e8eb-45d4-ad70-f6b87277c15f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.146660 Jun 27 14:59:31.186739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 315/565] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:31 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:31.195614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3c058f9b-6b33-4ab8-80d3-de42aa588ab7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:31.196217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3c058f9b-6b33-4ab8-80d3-de42aa588ab7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:31.202197 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c058f9b-6b33-4ab8-80d3-de42aa588ab7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:31.202641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c058f9b-6b33-4ab8-80d3-de42aa588ab7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:31.203979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c058f9b-6b33-4ab8-80d3-de42aa588ab7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:31.204505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c058f9b-6b33-4ab8-80d3-de42aa588ab7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:31.334978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3c058f9b-6b33-4ab8-80d3-de42aa588ab7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:31.342760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3c058f9b-6b33-4ab8-80d3-de42aa588ab7 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1314 microversion: 2.1 time: 0.150841 Jun 27 14:59:31.343311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 316/566] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:31 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:31.348163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cfd42b0b-60bc-4020-8abb-cfcc556f8912 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:31.352935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cfd42b0b-60bc-4020-8abb-cfcc556f8912 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:31.355122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfd42b0b-60bc-4020-8abb-cfcc556f8912 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:31.355560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfd42b0b-60bc-4020-8abb-cfcc556f8912 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:31.356307 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfd42b0b-60bc-4020-8abb-cfcc556f8912 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:31.356765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfd42b0b-60bc-4020-8abb-cfcc556f8912 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:31.418537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cfd42b0b-60bc-4020-8abb-cfcc556f8912 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:31.426750 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cfd42b0b-60bc-4020-8abb-cfcc556f8912 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1185 microversion: 2.1 time: 0.082201 Jun 27 14:59:31.436007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 317/567] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:31 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:31.436007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e2431575-7fe7-4b49-be33-60314b97ff81 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:31.436007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e2431575-7fe7-4b49-be33-60314b97ff81 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:31.439134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2431575-7fe7-4b49-be33-60314b97ff81 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:31.439581 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2431575-7fe7-4b49-be33-60314b97ff81 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:31.440327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2431575-7fe7-4b49-be33-60314b97ff81 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:31.440777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2431575-7fe7-4b49-be33-60314b97ff81 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:31.567183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e2431575-7fe7-4b49-be33-60314b97ff81 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:31.574410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e2431575-7fe7-4b49-be33-60314b97ff81 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.146145 Jun 27 14:59:31.574960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 318/568] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:31 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:32.203419 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-806eddb6-86cc-498a-b4ff-78f4dc45a4d5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:32.204462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-806eddb6-86cc-498a-b4ff-78f4dc45a4d5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:32.210884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-806eddb6-86cc-498a-b4ff-78f4dc45a4d5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:32.211332 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-806eddb6-86cc-498a-b4ff-78f4dc45a4d5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:32.212097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-806eddb6-86cc-498a-b4ff-78f4dc45a4d5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:32.212532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-806eddb6-86cc-498a-b4ff-78f4dc45a4d5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:32.345013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-806eddb6-86cc-498a-b4ff-78f4dc45a4d5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:32.352545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-806eddb6-86cc-498a-b4ff-78f4dc45a4d5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1514 microversion: 2.1 time: 0.153029 Jun 27 14:59:32.367358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 319/569] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:32 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:32.367358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1f287177-b510-4193-a070-8c1ec2d4f766 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:32.367358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1f287177-b510-4193-a070-8c1ec2d4f766 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:32.367358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f287177-b510-4193-a070-8c1ec2d4f766 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:32.367358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f287177-b510-4193-a070-8c1ec2d4f766 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:32.367845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f287177-b510-4193-a070-8c1ec2d4f766 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:32.367845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f287177-b510-4193-a070-8c1ec2d4f766 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:32.515194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1f287177-b510-4193-a070-8c1ec2d4f766 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:32.526079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1f287177-b510-4193-a070-8c1ec2d4f766 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1498 microversion: 2.1 time: 0.170378 Jun 27 14:59:32.527064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 320/570] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:32 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:32.537718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-c09e4743-9916-4df1-8b73-4ebdaed8ea4c req-17ad7dab-1279-4278-a4ec-7bc36112701b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9eabcc-8bc7-4501-b977-641ffd6bc5be", "name": "network-vif-deleted", "tag": "3441badc-ad12-4d5f-8cd2-2fe530516fbc"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:32.548276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-c09e4743-9916-4df1-8b73-4ebdaed8ea4c req-17ad7dab-1279-4278-a4ec-7bc36112701b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:32.548885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-c09e4743-9916-4df1-8b73-4ebdaed8ea4c req-17ad7dab-1279-4278-a4ec-7bc36112701b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:32.563955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-c09e4743-9916-4df1-8b73-4ebdaed8ea4c req-17ad7dab-1279-4278-a4ec-7bc36112701b service nova] Creating event network-vif-deleted:3441badc-ad12-4d5f-8cd2-2fe530516fbc for instance fa9eabcc-8bc7-4501-b977-641ffd6bc5be on hv-cinder-79760 Jun 27 14:59:32.570461 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-c09e4743-9916-4df1-8b73-4ebdaed8ea4c req-17ad7dab-1279-4278-a4ec-7bc36112701b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 Jun 27 14:59:32.573978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 321/571] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 14:59:32.577471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c9150a85-ad21-4fa7-ad07-08bffe39df67 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:32.579069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c9150a85-ad21-4fa7-ad07-08bffe39df67 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:32.588061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9150a85-ad21-4fa7-ad07-08bffe39df67 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:32.588887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9150a85-ad21-4fa7-ad07-08bffe39df67 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:32.589764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9150a85-ad21-4fa7-ad07-08bffe39df67 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:32.590306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9150a85-ad21-4fa7-ad07-08bffe39df67 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:32.669883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c9150a85-ad21-4fa7-ad07-08bffe39df67 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:32.676579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c9150a85-ad21-4fa7-ad07-08bffe39df67 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1185 microversion: 2.1 time: 0.104187 Jun 27 14:59:32.677160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 322/572] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:32 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:32.681735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-03138f06-2f47-4baa-a90a-e75bb766ff2f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:32.682457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-03138f06-2f47-4baa-a90a-e75bb766ff2f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:32.696580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-03138f06-2f47-4baa-a90a-e75bb766ff2f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:32.696580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-03138f06-2f47-4baa-a90a-e75bb766ff2f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:32.696580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-03138f06-2f47-4baa-a90a-e75bb766ff2f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:32.696580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-03138f06-2f47-4baa-a90a-e75bb766ff2f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:32.840316 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-03138f06-2f47-4baa-a90a-e75bb766ff2f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:32.847873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-03138f06-2f47-4baa-a90a-e75bb766ff2f tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1314 microversion: 2.1 time: 0.169752 Jun 27 14:59:32.849595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 323/573] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:32 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:33.371488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:33.372163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:33.378174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:33.378612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:33.379353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:33.379775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:33.408846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:33.409286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:33.409720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lazy-loading 'fault' on Instance uuid fa9eabcc-8bc7-4501-b977-641ffd6bc5be {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:59:33.448794 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:33.456283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b1899392-a9c8-4c1c-8544-26cb7219e228 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1308 microversion: 2.1 time: 0.088728 Jun 27 14:59:33.456869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 324/574] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:33 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1308 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:33.693144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-24d9af4f-b4af-4799-91b8-88041a91cbbb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:33.693747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-24d9af4f-b4af-4799-91b8-88041a91cbbb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:33.695656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:33.700324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24d9af4f-b4af-4799-91b8-88041a91cbbb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:33.700810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24d9af4f-b4af-4799-91b8-88041a91cbbb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:33.701567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24d9af4f-b4af-4799-91b8-88041a91cbbb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:33.701990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24d9af4f-b4af-4799-91b8-88041a91cbbb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:33.763731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-24d9af4f-b4af-4799-91b8-88041a91cbbb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:33.772326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-24d9af4f-b4af-4799-91b8-88041a91cbbb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1185 microversion: 2.1 time: 0.083000 Jun 27 14:59:33.773925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 325/575] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:33 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:33.864326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-830aae6b-e670-443c-8f06-02bbda317e22 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:33.864961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-830aae6b-e670-443c-8f06-02bbda317e22 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:33.871382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-830aae6b-e670-443c-8f06-02bbda317e22 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:33.871864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-830aae6b-e670-443c-8f06-02bbda317e22 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:33.872877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-830aae6b-e670-443c-8f06-02bbda317e22 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:33.873345 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-830aae6b-e670-443c-8f06-02bbda317e22 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.011178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-830aae6b-e670-443c-8f06-02bbda317e22 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:34.019606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-830aae6b-e670-443c-8f06-02bbda317e22 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1464 microversion: 2.1 time: 0.159200 Jun 27 14:59:34.020235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 326/576] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:33 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:34.024579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0f49f69f-4b16-48e0-8d05-f444ba04738b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:34.025095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0f49f69f-4b16-48e0-8d05-f444ba04738b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:34.030634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f49f69f-4b16-48e0-8d05-f444ba04738b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.031477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f49f69f-4b16-48e0-8d05-f444ba04738b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.032363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f49f69f-4b16-48e0-8d05-f444ba04738b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.032831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f49f69f-4b16-48e0-8d05-f444ba04738b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.057821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0f49f69f-4b16-48e0-8d05-f444ba04738b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 14:59:34.085908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:34.386321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0f49f69f-4b16-48e0-8d05-f444ba04738b tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "DELETE /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 204 len: 0 microversion: 2.1 time: 0.364816 Jun 27 14:59:34.390697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 327/577] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 14:59:34 2022] DELETE /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 14:59:34.399621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6413dcfa-2a01-4498-b170-49a843b0077b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:34.399621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6413dcfa-2a01-4498-b170-49a843b0077b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:34.401432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6413dcfa-2a01-4498-b170-49a843b0077b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.401885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6413dcfa-2a01-4498-b170-49a843b0077b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.403753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6413dcfa-2a01-4498-b170-49a843b0077b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.403753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6413dcfa-2a01-4498-b170-49a843b0077b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.433228 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6413dcfa-2a01-4498-b170-49a843b0077b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 14:59:34.435974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=8 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:34.720452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6413dcfa-2a01-4498-b170-49a843b0077b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "DELETE /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 204 len: 0 microversion: 2.1 time: 0.331175 Jun 27 14:59:34.721066 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 328/578] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 14:59:34 2022] DELETE /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 14:59:34.727218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3ff67ab0-e1cf-446f-b150-a7dd39d79961 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:34.727909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3ff67ab0-e1cf-446f-b150-a7dd39d79961 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:34.733802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ff67ab0-e1cf-446f-b150-a7dd39d79961 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.734250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ff67ab0-e1cf-446f-b150-a7dd39d79961 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.735803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ff67ab0-e1cf-446f-b150-a7dd39d79961 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.736240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ff67ab0-e1cf-446f-b150-a7dd39d79961 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.866897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3ff67ab0-e1cf-446f-b150-a7dd39d79961 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:34.874218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3ff67ab0-e1cf-446f-b150-a7dd39d79961 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.151321 Jun 27 14:59:34.874769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 329/579] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:34 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:34.879043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:34.879641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:34.885220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.887898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.887898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.887898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.916112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.916554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.917020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lazy-loading 'fault' on Instance uuid fa9eabcc-8bc7-4501-b977-641ffd6bc5be {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:59:34.956761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:34.964074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c8aa7f4e-49f0-4047-9e91-33dd1ce630e4 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1308 microversion: 2.1 time: 0.088185 Jun 27 14:59:34.964634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 330/580] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:34 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:34.969639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-275881d9-5d44-4772-bcd7-fe9116e83f2e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:34.970235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-275881d9-5d44-4772-bcd7-fe9116e83f2e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:34.976244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-275881d9-5d44-4772-bcd7-fe9116e83f2e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.976726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-275881d9-5d44-4772-bcd7-fe9116e83f2e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:34.977489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-275881d9-5d44-4772-bcd7-fe9116e83f2e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:34.977918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-275881d9-5d44-4772-bcd7-fe9116e83f2e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:35.113443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-275881d9-5d44-4772-bcd7-fe9116e83f2e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:35.121785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-275881d9-5d44-4772-bcd7-fe9116e83f2e tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.156148 Jun 27 14:59:35.123814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 331/581] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:34 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:35.129208 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f9f2ad32-5d20-43fa-bd8e-27e43902417d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:35.134609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f9f2ad32-5d20-43fa-bd8e-27e43902417d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:35.135647 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f9f2ad32-5d20-43fa-bd8e-27e43902417d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:35.136088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f9f2ad32-5d20-43fa-bd8e-27e43902417d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:35.136856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f9f2ad32-5d20-43fa-bd8e-27e43902417d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:35.137283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f9f2ad32-5d20-43fa-bd8e-27e43902417d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:35.198554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f9f2ad32-5d20-43fa-bd8e-27e43902417d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:35.206220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f9f2ad32-5d20-43fa-bd8e-27e43902417d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1203 microversion: 2.1 time: 0.081516 Jun 27 14:59:35.211579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 332/582] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:35 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1203 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:35.891907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-88d94c07-9e10-4c1a-95c7-b8906cb094f5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:35.892556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-88d94c07-9e10-4c1a-95c7-b8906cb094f5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:35.898537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-88d94c07-9e10-4c1a-95c7-b8906cb094f5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:35.898977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-88d94c07-9e10-4c1a-95c7-b8906cb094f5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:35.899726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-88d94c07-9e10-4c1a-95c7-b8906cb094f5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:35.900155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-88d94c07-9e10-4c1a-95c7-b8906cb094f5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:36.026979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-88d94c07-9e10-4c1a-95c7-b8906cb094f5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:36.034988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-88d94c07-9e10-4c1a-95c7-b8906cb094f5 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.147418 Jun 27 14:59:36.035539 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 333/583] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:35 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:36.047080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:36.047080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:36.047080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:36.047080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:36.047585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:36.048075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:36.078104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:36.079056 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:36.079503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lazy-loading 'fault' on Instance uuid fa9eabcc-8bc7-4501-b977-641ffd6bc5be {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:59:36.120060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:36.128075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-efd88111-7b30-4b80-b779-92e6d3a4ea4c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 200 len: 1308 microversion: 2.1 time: 0.091499 Jun 27 14:59:36.128658 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 334/584] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:36 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:36.138783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b0b87bef-4d1d-4ed1-91bc-ee3f1f20d804 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:36.139378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b0b87bef-4d1d-4ed1-91bc-ee3f1f20d804 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:36.146035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0b87bef-4d1d-4ed1-91bc-ee3f1f20d804 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:36.146415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0b87bef-4d1d-4ed1-91bc-ee3f1f20d804 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:36.147166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0b87bef-4d1d-4ed1-91bc-ee3f1f20d804 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:36.147591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0b87bef-4d1d-4ed1-91bc-ee3f1f20d804 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:36.283870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b0b87bef-4d1d-4ed1-91bc-ee3f1f20d804 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:36.291631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b0b87bef-4d1d-4ed1-91bc-ee3f1f20d804 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.156389 Jun 27 14:59:36.292398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 335/585] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:36 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:36.306275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9c4c40bb-0590-4d02-9405-8a9bf0d19172 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:36.306904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9c4c40bb-0590-4d02-9405-8a9bf0d19172 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:36.313694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c4c40bb-0590-4d02-9405-8a9bf0d19172 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:36.314433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c4c40bb-0590-4d02-9405-8a9bf0d19172 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:36.315273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c4c40bb-0590-4d02-9405-8a9bf0d19172 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:36.315781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c4c40bb-0590-4d02-9405-8a9bf0d19172 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:36.378295 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9c4c40bb-0590-4d02-9405-8a9bf0d19172 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:36.385697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9c4c40bb-0590-4d02-9405-8a9bf0d19172 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1203 microversion: 2.1 time: 0.083170 Jun 27 14:59:36.386248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 336/586] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:36 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1203 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:37.051559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7d5c9804-a326-4260-85cc-6c83bb4c44bd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:37.052193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7d5c9804-a326-4260-85cc-6c83bb4c44bd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:37.058163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7d5c9804-a326-4260-85cc-6c83bb4c44bd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:37.058594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7d5c9804-a326-4260-85cc-6c83bb4c44bd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:37.059339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7d5c9804-a326-4260-85cc-6c83bb4c44bd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:37.059763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7d5c9804-a326-4260-85cc-6c83bb4c44bd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:37.190163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7d5c9804-a326-4260-85cc-6c83bb4c44bd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:37.197454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7d5c9804-a326-4260-85cc-6c83bb4c44bd tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.150043 Jun 27 14:59:37.198028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 337/587] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:37 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:37.202305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:37.202900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: fa9eabcc-8bc7-4501-b977-641ffd6bc5be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:37.208915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:37.209360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:37.210106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:37.210534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:37.223408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] HTTP exception thrown: Instance fa9eabcc-8bc7-4501-b977-641ffd6bc5be could not be found. Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Request method failure captured: Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be HTTP/1.1 Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucUmIJKZJHeCrIGWnP6WkJYxeNaIdgXmzC8kJmlz093eJwWYSX4mCk4YjvXk-aObGQEtGfR-kUJFlugyPanmUPX_x4N_0L7fAOzOA0eHIlUKoQpfL3Hx8J6z7cl07Jgs65FQkI4dyEjgrl0gfntnxK5DkG4gVlGxrkHoxovO301stf8 Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 88f69fa608db4724a066a8dde7efe38a Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2023575950 Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 14:59:37.225033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_88f69fa608db4724a066a8dde7efe38a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88f69fa608db4724a066a8dde7efe38a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/88f69fa608db4724a066a8dde7efe38a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88f69fa608db4724a066a8dde7efe38a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesSnapshotTestJSON-2023575950 Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 88f69fa608db4724a066a8dde7efe38a Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2023575950 Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesSnapshotTestJSON-2023575950-project Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: e7c4678d1aa9425db97adc6cce76e74f Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesSnapshotTestJSON-2023575950-project Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance fa9eabcc-8bc7-4501-b977-641ffd6bc5be could not be found. Jun 27 14:59:37.226571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'fa9eabcc-8bc7-4501-b977-641ffd6bc5be'} Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa9eabcc-8bc7-4501-b977-641ffd6bc5be could not be found. Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:59:37.227531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa9eabcc-8bc7-4501-b977-641ffd6bc5be could not be found. Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa9eabcc-8bc7-4501-b977-641ffd6bc5be could not be found. Jun 27 14:59:37.229043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:37.230323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Returning 404 to user: Instance fa9eabcc-8bc7-4501-b977-641ffd6bc5be could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:59:37.230323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-41190cfd-6304-4b7b-b822-a99965488b71 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be" status: 404 len: 111 microversion: 2.1 time: 0.027448 Jun 27 14:59:37.230323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 338/588] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:37 2022] GET /compute/v2.1/servers/fa9eabcc-8bc7-4501-b977-641ffd6bc5be => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 14:59:37.309158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5392ad91-eb98-48ab-ade2-c2dd13242e9c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:37.309954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5392ad91-eb98-48ab-ade2-c2dd13242e9c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:37.316579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5392ad91-eb98-48ab-ade2-c2dd13242e9c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:37.317047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5392ad91-eb98-48ab-ade2-c2dd13242e9c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:37.317804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5392ad91-eb98-48ab-ade2-c2dd13242e9c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:37.318234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5392ad91-eb98-48ab-ade2-c2dd13242e9c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:37.445379 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5392ad91-eb98-48ab-ade2-c2dd13242e9c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:37.452884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5392ad91-eb98-48ab-ade2-c2dd13242e9c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.147618 Jun 27 14:59:37.453447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 339/589] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:37 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:37.457991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9ab6b73c-4cd3-42fb-84c7-50bf3f653112 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:37.458584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9ab6b73c-4cd3-42fb-84c7-50bf3f653112 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:37.460294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:37.465015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ab6b73c-4cd3-42fb-84c7-50bf3f653112 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:37.465492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ab6b73c-4cd3-42fb-84c7-50bf3f653112 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:37.466263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ab6b73c-4cd3-42fb-84c7-50bf3f653112 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:37.466688 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ab6b73c-4cd3-42fb-84c7-50bf3f653112 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:37.600729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9ab6b73c-4cd3-42fb-84c7-50bf3f653112 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:37.608037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9ab6b73c-4cd3-42fb-84c7-50bf3f653112 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1271 microversion: 2.1 time: 0.153646 Jun 27 14:59:37.610371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 340/590] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:37 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:38.214872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1a6a51b5-f4fe-44d7-983a-0c4d44260999 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:38.215475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1a6a51b5-f4fe-44d7-983a-0c4d44260999 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:38.222099 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a6a51b5-f4fe-44d7-983a-0c4d44260999 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:38.222537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a6a51b5-f4fe-44d7-983a-0c4d44260999 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:38.223279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a6a51b5-f4fe-44d7-983a-0c4d44260999 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:38.223702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a6a51b5-f4fe-44d7-983a-0c4d44260999 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:38.348053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1a6a51b5-f4fe-44d7-983a-0c4d44260999 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:38.351408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:38.355638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1a6a51b5-f4fe-44d7-983a-0c4d44260999 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.144634 Jun 27 14:59:38.356188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 341/591] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:38 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:38.470035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3e83cd32-27f6-4c00-8163-91076481f64b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:38.470636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3e83cd32-27f6-4c00-8163-91076481f64b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:38.477143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e83cd32-27f6-4c00-8163-91076481f64b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:38.477580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e83cd32-27f6-4c00-8163-91076481f64b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:38.478332 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e83cd32-27f6-4c00-8163-91076481f64b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:38.478753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e83cd32-27f6-4c00-8163-91076481f64b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:38.607958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3e83cd32-27f6-4c00-8163-91076481f64b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:38.615466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3e83cd32-27f6-4c00-8163-91076481f64b tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.149791 Jun 27 14:59:38.616014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 342/592] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:38 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:38.625780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0e5c83d6-de20-4eb9-9384-4ca9d940cc0b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:38.626369 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0e5c83d6-de20-4eb9-9384-4ca9d940cc0b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:38.631947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e5c83d6-de20-4eb9-9384-4ca9d940cc0b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:38.632414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e5c83d6-de20-4eb9-9384-4ca9d940cc0b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:38.633173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e5c83d6-de20-4eb9-9384-4ca9d940cc0b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:38.633600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e5c83d6-de20-4eb9-9384-4ca9d940cc0b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:38.763897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0e5c83d6-de20-4eb9-9384-4ca9d940cc0b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:38.771981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0e5c83d6-de20-4eb9-9384-4ca9d940cc0b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1271 microversion: 2.1 time: 0.150320 Jun 27 14:59:38.772530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 343/593] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:38 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:39.372519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1ec30fb5-dd2e-4430-ab6f-21f882860da8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:39.373183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1ec30fb5-dd2e-4430-ab6f-21f882860da8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:39.379243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1ec30fb5-dd2e-4430-ab6f-21f882860da8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:39.379678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1ec30fb5-dd2e-4430-ab6f-21f882860da8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:39.380478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1ec30fb5-dd2e-4430-ab6f-21f882860da8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:39.380944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1ec30fb5-dd2e-4430-ab6f-21f882860da8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:39.515239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1ec30fb5-dd2e-4430-ab6f-21f882860da8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:39.522898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1ec30fb5-dd2e-4430-ab6f-21f882860da8 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.154246 Jun 27 14:59:39.523454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 344/594] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:39 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:39.632620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-745bf20f-8e71-4245-b053-7645d34a6486 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:39.633178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-745bf20f-8e71-4245-b053-7645d34a6486 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:39.639179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-745bf20f-8e71-4245-b053-7645d34a6486 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:39.639624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-745bf20f-8e71-4245-b053-7645d34a6486 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:39.640382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-745bf20f-8e71-4245-b053-7645d34a6486 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:39.641454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-745bf20f-8e71-4245-b053-7645d34a6486 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:39.790257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-745bf20f-8e71-4245-b053-7645d34a6486 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:39.799530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-745bf20f-8e71-4245-b053-7645d34a6486 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.170977 Jun 27 14:59:39.800376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 345/595] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:39 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:39.806205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-01d4fc87-8406-4476-929d-4a636f3f58b0 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:39.806205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-01d4fc87-8406-4476-929d-4a636f3f58b0 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:39.814487 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01d4fc87-8406-4476-929d-4a636f3f58b0 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:39.814487 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01d4fc87-8406-4476-929d-4a636f3f58b0 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:39.815260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01d4fc87-8406-4476-929d-4a636f3f58b0 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:39.815679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01d4fc87-8406-4476-929d-4a636f3f58b0 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:39.948179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-01d4fc87-8406-4476-929d-4a636f3f58b0 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:39.956498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-01d4fc87-8406-4476-929d-4a636f3f58b0 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1271 microversion: 2.1 time: 0.155303 Jun 27 14:59:39.957088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 346/596] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:39 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:40.540736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2b04f9cb-57af-45e2-bdd7-bc0a74a00f26 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:40.541462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2b04f9cb-57af-45e2-bdd7-bc0a74a00f26 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:40.547996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b04f9cb-57af-45e2-bdd7-bc0a74a00f26 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:40.548439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b04f9cb-57af-45e2-bdd7-bc0a74a00f26 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:40.549210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b04f9cb-57af-45e2-bdd7-bc0a74a00f26 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:40.549636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b04f9cb-57af-45e2-bdd7-bc0a74a00f26 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:40.683007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2b04f9cb-57af-45e2-bdd7-bc0a74a00f26 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:40.691700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2b04f9cb-57af-45e2-bdd7-bc0a74a00f26 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.154987 Jun 27 14:59:40.692777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 347/597] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:40 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:40.816722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7ced2f93-bcff-417e-bbfe-848cc7f913ef tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:40.817336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7ced2f93-bcff-417e-bbfe-848cc7f913ef tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:40.823285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ced2f93-bcff-417e-bbfe-848cc7f913ef tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:40.823733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ced2f93-bcff-417e-bbfe-848cc7f913ef tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:40.824488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ced2f93-bcff-417e-bbfe-848cc7f913ef tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:40.824956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ced2f93-bcff-417e-bbfe-848cc7f913ef tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:40.953997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7ced2f93-bcff-417e-bbfe-848cc7f913ef tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:40.961522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7ced2f93-bcff-417e-bbfe-848cc7f913ef tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.148915 Jun 27 14:59:40.962082 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 348/598] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:40 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:40.973444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-97fb4c1a-566e-4a21-99c8-d03f2a0cc103 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:40.974034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-97fb4c1a-566e-4a21-99c8-d03f2a0cc103 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:40.979908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97fb4c1a-566e-4a21-99c8-d03f2a0cc103 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:40.980428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97fb4c1a-566e-4a21-99c8-d03f2a0cc103 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:40.981192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97fb4c1a-566e-4a21-99c8-d03f2a0cc103 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:40.981626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97fb4c1a-566e-4a21-99c8-d03f2a0cc103 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:41.113197 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-97fb4c1a-566e-4a21-99c8-d03f2a0cc103 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:41.120765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-97fb4c1a-566e-4a21-99c8-d03f2a0cc103 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1271 microversion: 2.1 time: 0.151922 Jun 27 14:59:41.121327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 349/599] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:40 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:41.708978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-78cf1804-ee55-4ef5-b75e-c71c3d49e38c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:41.709646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-78cf1804-ee55-4ef5-b75e-c71c3d49e38c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:41.715523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78cf1804-ee55-4ef5-b75e-c71c3d49e38c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:41.715962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78cf1804-ee55-4ef5-b75e-c71c3d49e38c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:41.716727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78cf1804-ee55-4ef5-b75e-c71c3d49e38c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:41.717154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78cf1804-ee55-4ef5-b75e-c71c3d49e38c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:41.846486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-78cf1804-ee55-4ef5-b75e-c71c3d49e38c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:41.853788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-78cf1804-ee55-4ef5-b75e-c71c3d49e38c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.148710 Jun 27 14:59:41.854342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 350/600] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:41 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:41.978846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-446c1119-b041-42df-b06c-6a1507ab9658 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:41.979376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-446c1119-b041-42df-b06c-6a1507ab9658 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:41.985474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-446c1119-b041-42df-b06c-6a1507ab9658 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:41.985920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-446c1119-b041-42df-b06c-6a1507ab9658 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:41.986672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-446c1119-b041-42df-b06c-6a1507ab9658 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:41.987101 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-446c1119-b041-42df-b06c-6a1507ab9658 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:42.113814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-446c1119-b041-42df-b06c-6a1507ab9658 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:42.121542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-446c1119-b041-42df-b06c-6a1507ab9658 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.146525 Jun 27 14:59:42.122108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 351/601] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:41 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:42.137499 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9dcb3f88-6ad9-405d-b7ac-bbfbca03098e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:42.138100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9dcb3f88-6ad9-405d-b7ac-bbfbca03098e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:42.144601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dcb3f88-6ad9-405d-b7ac-bbfbca03098e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:42.145071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dcb3f88-6ad9-405d-b7ac-bbfbca03098e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:42.145851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dcb3f88-6ad9-405d-b7ac-bbfbca03098e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:42.146280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dcb3f88-6ad9-405d-b7ac-bbfbca03098e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:42.276395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9dcb3f88-6ad9-405d-b7ac-bbfbca03098e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:42.283851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9dcb3f88-6ad9-405d-b7ac-bbfbca03098e tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1271 microversion: 2.1 time: 0.150156 Jun 27 14:59:42.284407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 352/602] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:42 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:42.870592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ac29e839-410b-4301-ae45-614664b6df56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:42.871279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ac29e839-410b-4301-ae45-614664b6df56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:42.877847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac29e839-410b-4301-ae45-614664b6df56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:42.878282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac29e839-410b-4301-ae45-614664b6df56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:42.879023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac29e839-410b-4301-ae45-614664b6df56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:42.879446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac29e839-410b-4301-ae45-614664b6df56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:43.004380 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ac29e839-410b-4301-ae45-614664b6df56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:43.014052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ac29e839-410b-4301-ae45-614664b6df56 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.147053 Jun 27 14:59:43.014955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 353/603] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:42 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:43.138693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3f49a928-45a3-44d2-81b1-04637472b367 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:43.139357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3f49a928-45a3-44d2-81b1-04637472b367 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:43.145495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f49a928-45a3-44d2-81b1-04637472b367 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:43.145938 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f49a928-45a3-44d2-81b1-04637472b367 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:43.146741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f49a928-45a3-44d2-81b1-04637472b367 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:43.147170 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f49a928-45a3-44d2-81b1-04637472b367 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:43.275279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3f49a928-45a3-44d2-81b1-04637472b367 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:43.283334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3f49a928-45a3-44d2-81b1-04637472b367 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.148530 Jun 27 14:59:43.283892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 354/604] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:43 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:43.299956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-456262f8-3769-46e3-b80f-7d38c19e5221 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:43.300544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-456262f8-3769-46e3-b80f-7d38c19e5221 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:43.306127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-456262f8-3769-46e3-b80f-7d38c19e5221 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:43.306565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-456262f8-3769-46e3-b80f-7d38c19e5221 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:43.307303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-456262f8-3769-46e3-b80f-7d38c19e5221 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:43.307725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-456262f8-3769-46e3-b80f-7d38c19e5221 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:43.433217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-456262f8-3769-46e3-b80f-7d38c19e5221 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:43.440798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-456262f8-3769-46e3-b80f-7d38c19e5221 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1271 microversion: 2.1 time: 0.144996 Jun 27 14:59:43.441357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 355/605] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:43 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:44.031107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-188d9943-6d3e-488d-ba86-2338baa7743c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:44.031811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-188d9943-6d3e-488d-ba86-2338baa7743c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:44.037814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-188d9943-6d3e-488d-ba86-2338baa7743c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:44.038202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-188d9943-6d3e-488d-ba86-2338baa7743c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:44.038948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-188d9943-6d3e-488d-ba86-2338baa7743c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:44.039373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-188d9943-6d3e-488d-ba86-2338baa7743c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:44.166571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-188d9943-6d3e-488d-ba86-2338baa7743c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:44.174831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-188d9943-6d3e-488d-ba86-2338baa7743c tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.147551 Jun 27 14:59:44.175627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 356/606] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:44 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:44.300395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-65d46f82-1d77-4252-bd13-2cb17e68b124 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:44.300987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-65d46f82-1d77-4252-bd13-2cb17e68b124 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:44.307046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65d46f82-1d77-4252-bd13-2cb17e68b124 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:44.307493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65d46f82-1d77-4252-bd13-2cb17e68b124 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:44.308250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65d46f82-1d77-4252-bd13-2cb17e68b124 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:44.308698 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65d46f82-1d77-4252-bd13-2cb17e68b124 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:44.673282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-65d46f82-1d77-4252-bd13-2cb17e68b124 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:44.680871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-65d46f82-1d77-4252-bd13-2cb17e68b124 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.385225 Jun 27 14:59:44.681433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 357/607] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:44 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:44.685722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bbf817b7-36ac-46ae-889e-48355fe0030b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:44.686310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bbf817b7-36ac-46ae-889e-48355fe0030b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:44.692120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bbf817b7-36ac-46ae-889e-48355fe0030b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:44.696085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bbf817b7-36ac-46ae-889e-48355fe0030b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:44.696085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bbf817b7-36ac-46ae-889e-48355fe0030b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:44.696085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bbf817b7-36ac-46ae-889e-48355fe0030b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:44.712210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:44.852052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bbf817b7-36ac-46ae-889e-48355fe0030b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:44.861326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bbf817b7-36ac-46ae-889e-48355fe0030b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1271 microversion: 2.1 time: 0.178858 Jun 27 14:59:44.862059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 358/608] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:44 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:45.087244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-3e832b1d-57fe-4d5c-add2-581370f339c6 req-a9da2be5-ff36-4622-ae15-85ae99bcf2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08c8875-88c6-490f-a2a7-b0332d129e3d", "tag": "05abf890-aa38-4cf8-b0bb-92c6ba77980d"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:45.096021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-3e832b1d-57fe-4d5c-add2-581370f339c6 req-a9da2be5-ff36-4622-ae15-85ae99bcf2e9 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:45.096559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-3e832b1d-57fe-4d5c-add2-581370f339c6 req-a9da2be5-ff36-4622-ae15-85ae99bcf2e9 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:45.112106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-3e832b1d-57fe-4d5c-add2-581370f339c6 req-a9da2be5-ff36-4622-ae15-85ae99bcf2e9 service nova] Creating event network-changed:05abf890-aa38-4cf8-b0bb-92c6ba77980d for instance e08c8875-88c6-490f-a2a7-b0332d129e3d on hv-cinder-79760 Jun 27 14:59:45.116509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-3e832b1d-57fe-4d5c-add2-581370f339c6 req-a9da2be5-ff36-4622-ae15-85ae99bcf2e9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034550 Jun 27 14:59:45.117299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 359/609] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:59:45.193027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a49581dc-b849-47fa-a19c-64f5584f7eb3 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:45.193729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a49581dc-b849-47fa-a19c-64f5584f7eb3 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:45.200127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a49581dc-b849-47fa-a19c-64f5584f7eb3 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:45.200576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a49581dc-b849-47fa-a19c-64f5584f7eb3 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:45.201412 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a49581dc-b849-47fa-a19c-64f5584f7eb3 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:45.201850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a49581dc-b849-47fa-a19c-64f5584f7eb3 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:45.338680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a49581dc-b849-47fa-a19c-64f5584f7eb3 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:45.349036 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a49581dc-b849-47fa-a19c-64f5584f7eb3 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1504 microversion: 2.1 time: 0.161225 Jun 27 14:59:45.349716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 360/610] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:45 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:45.697918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-444e2e0f-d766-45ef-8a01-5a8e0cd4eb1c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:45.698530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-444e2e0f-d766-45ef-8a01-5a8e0cd4eb1c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:45.704784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-444e2e0f-d766-45ef-8a01-5a8e0cd4eb1c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:45.705166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-444e2e0f-d766-45ef-8a01-5a8e0cd4eb1c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:45.705991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-444e2e0f-d766-45ef-8a01-5a8e0cd4eb1c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:45.706392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-444e2e0f-d766-45ef-8a01-5a8e0cd4eb1c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:45.876771 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-444e2e0f-d766-45ef-8a01-5a8e0cd4eb1c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:45.887722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-444e2e0f-d766-45ef-8a01-5a8e0cd4eb1c tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1470 microversion: 2.1 time: 0.193636 Jun 27 14:59:45.889625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 361/611] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:45 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:45.896241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b80b98d4-afc8-445a-a6fb-0f3ce3e689d7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:45.901815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b80b98d4-afc8-445a-a6fb-0f3ce3e689d7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:45.906608 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b80b98d4-afc8-445a-a6fb-0f3ce3e689d7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:45.907550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b80b98d4-afc8-445a-a6fb-0f3ce3e689d7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:45.908551 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b80b98d4-afc8-445a-a6fb-0f3ce3e689d7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:45.909297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b80b98d4-afc8-445a-a6fb-0f3ce3e689d7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:46.199204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b80b98d4-afc8-445a-a6fb-0f3ce3e689d7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:46.206751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b80b98d4-afc8-445a-a6fb-0f3ce3e689d7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1271 microversion: 2.1 time: 0.315782 Jun 27 14:59:46.207317 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 362/612] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:45 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1271 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:46.367211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:46.367899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:46.374918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:46.375968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:46.376965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:46.377426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:46.412072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:46.412567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:46.413069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lazy-loading 'fault' on Instance uuid 094071af-88ab-4d0b-b351-11aa81077ebd {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:59:46.460543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef044785763a4bc4be4a1ffd4ea5290f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b79598ec54243258d2f2f589be4940d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:46.468563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-330dd413-a942-4e42-b5fc-581a37005244 tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 200 len: 1304 microversion: 2.1 time: 0.105086 Jun 27 14:59:46.471921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 363/613] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:46 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:46.579293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-3dc1df60-793c-4e14-9cb9-f5b5c2b0be66 req-8f29da9d-7084-4f2d-9c01-ceaea64c8856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e0606f-8bab-4c30-ae7e-82708c23e054", "name": "network-vif-deleted", "tag": "5d2059ae-f1b6-46f6-b474-af4d48ffa6ee"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:46.588488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-3dc1df60-793c-4e14-9cb9-f5b5c2b0be66 req-8f29da9d-7084-4f2d-9c01-ceaea64c8856 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:46.588956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-3dc1df60-793c-4e14-9cb9-f5b5c2b0be66 req-8f29da9d-7084-4f2d-9c01-ceaea64c8856 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:46.600941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-3dc1df60-793c-4e14-9cb9-f5b5c2b0be66 req-8f29da9d-7084-4f2d-9c01-ceaea64c8856 service nova] Creating event network-vif-deleted:5d2059ae-f1b6-46f6-b474-af4d48ffa6ee for instance 78e0606f-8bab-4c30-ae7e-82708c23e054 on hv-cinder-79760 Jun 27 14:59:46.606190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-3dc1df60-793c-4e14-9cb9-f5b5c2b0be66 req-8f29da9d-7084-4f2d-9c01-ceaea64c8856 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030731 Jun 27 14:59:46.606900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 364/614] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:59:46.905342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-14830690-4811-4019-aa32-f89d9f016156 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:46.906732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-14830690-4811-4019-aa32-f89d9f016156 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:46.913067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-14830690-4811-4019-aa32-f89d9f016156 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:46.913510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-14830690-4811-4019-aa32-f89d9f016156 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:46.914273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-14830690-4811-4019-aa32-f89d9f016156 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:46.914698 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-14830690-4811-4019-aa32-f89d9f016156 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:46.980161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-14830690-4811-4019-aa32-f89d9f016156 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:46.988899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-14830690-4811-4019-aa32-f89d9f016156 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1299 microversion: 2.1 time: 0.087587 Jun 27 14:59:46.989471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 365/615] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:46 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:47.131724 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-ecb74737-54c4-434d-903c-3943614f3823 req-189b80de-31a9-4da8-a975-29b97110c0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094071af-88ab-4d0b-b351-11aa81077ebd", "name": "network-vif-deleted", "tag": "1c3fdae4-f9aa-4a9b-9036-d0ab24130b54"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:47.139706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-ecb74737-54c4-434d-903c-3943614f3823 req-189b80de-31a9-4da8-a975-29b97110c0f3 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:47.140136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-ecb74737-54c4-434d-903c-3943614f3823 req-189b80de-31a9-4da8-a975-29b97110c0f3 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:47.153301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-ecb74737-54c4-434d-903c-3943614f3823 req-189b80de-31a9-4da8-a975-29b97110c0f3 service nova] Creating event network-vif-deleted:1c3fdae4-f9aa-4a9b-9036-d0ab24130b54 for instance 094071af-88ab-4d0b-b351-11aa81077ebd on hv-cinder-79760 Jun 27 14:59:47.159416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-ecb74737-54c4-434d-903c-3943614f3823 req-189b80de-31a9-4da8-a975-29b97110c0f3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Jun 27 14:59:47.159996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 366/616] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 14:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 14:59:47.224613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e87f2ee3-afd0-4b21-8092-875f98ad819d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:47.225323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e87f2ee3-afd0-4b21-8092-875f98ad819d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:47.231401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e87f2ee3-afd0-4b21-8092-875f98ad819d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:47.231839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e87f2ee3-afd0-4b21-8092-875f98ad819d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:47.232584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e87f2ee3-afd0-4b21-8092-875f98ad819d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:47.233044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e87f2ee3-afd0-4b21-8092-875f98ad819d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:47.371112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e87f2ee3-afd0-4b21-8092-875f98ad819d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:47.378732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e87f2ee3-afd0-4b21-8092-875f98ad819d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.158382 Jun 27 14:59:47.379291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 367/617] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:47 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:47.486905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:47.487478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] [instance: 094071af-88ab-4d0b-b351-11aa81077ebd] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:47.493438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:47.493874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:47.494614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:47.495040 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:47.508536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] HTTP exception thrown: Instance 094071af-88ab-4d0b-b351-11aa81077ebd could not be found. Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Request method failure captured: Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd HTTP/1.1 Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucVsELryjrzMfX5Of6K7QuX0UTQY3dbCL6UrSAFwHfA81gvi4Ah9AeusVlUEDH6ouUqF3mTvEJU9xpSnHL4xPJ7JQRPkDw8_0uNg4d941z0ZVNJsgKYmpyTTOAeqaDCTwmGvTD9BNBinZ3I1XzD8dZYM6YgoPy8ZL7Fp8bO18dYIKsU Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 0b79598ec54243258d2f2f589be4940d Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesActionsTest-1428158574 Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 14:59:47.510371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0b79598ec54243258d2f2f589be4940d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0b79598ec54243258d2f2f589be4940d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0b79598ec54243258d2f2f589be4940d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0b79598ec54243258d2f2f589be4940d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesActionsTest-1428158574 Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 0b79598ec54243258d2f2f589be4940d Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesActionsTest-1428158574 Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesActionsTest-1428158574-project Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: ef044785763a4bc4be4a1ffd4ea5290f Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesActionsTest-1428158574-project Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 094071af-88ab-4d0b-b351-11aa81077ebd could not be found. Jun 27 14:59:47.511939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '094071af-88ab-4d0b-b351-11aa81077ebd'} Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094071af-88ab-4d0b-b351-11aa81077ebd could not be found. Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:59:47.513032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094071af-88ab-4d0b-b351-11aa81077ebd could not be found. Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094071af-88ab-4d0b-b351-11aa81077ebd could not be found. Jun 27 14:59:47.514456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:47.516222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] Returning 404 to user: Instance 094071af-88ab-4d0b-b351-11aa81077ebd could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:59:47.516222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a1abaa42-135c-4b0b-92ff-1c480a9860be tempest-VolumesActionsTest-1428158574 tempest-VolumesActionsTest-1428158574-project] 10.222.0.44 "GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd" status: 404 len: 111 microversion: 2.1 time: 0.028743 Jun 27 14:59:47.516222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 368/618] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:47 2022] GET /compute/v2.1/servers/094071af-88ab-4d0b-b351-11aa81077ebd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 14:59:48.005732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:48.010591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:48.012212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:48.012664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:48.013464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:48.013892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:48.044965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:48.045559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:48.046177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lazy-loading 'fault' on Instance uuid 78e0606f-8bab-4c30-ae7e-82708c23e054 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:59:48.102552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:48.104567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e74e53e9-ce13-46bd-971d-6c7d70039690 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1304 microversion: 2.1 time: 0.102610 Jun 27 14:59:48.109977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 369/619] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:48 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:48.395251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7eab0a1f-5418-4d0d-926e-865a8359fd94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:48.395895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7eab0a1f-5418-4d0d-926e-865a8359fd94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:48.401883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7eab0a1f-5418-4d0d-926e-865a8359fd94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:48.402326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7eab0a1f-5418-4d0d-926e-865a8359fd94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:48.403074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7eab0a1f-5418-4d0d-926e-865a8359fd94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:48.403501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7eab0a1f-5418-4d0d-926e-865a8359fd94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:48.541411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7eab0a1f-5418-4d0d-926e-865a8359fd94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:48.549577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7eab0a1f-5418-4d0d-926e-865a8359fd94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.158076 Jun 27 14:59:48.550128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 370/620] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:48 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:49.122599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:49.123246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:49.129449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:49.130023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:49.132224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:49.132224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:49.163337 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:49.163775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:49.164208 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lazy-loading 'fault' on Instance uuid 78e0606f-8bab-4c30-ae7e-82708c23e054 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:59:49.204689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:49.211955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-dd81d1ff-4fdb-416e-9346-172810fd1d27 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1304 microversion: 2.1 time: 0.093830 Jun 27 14:59:49.212501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 371/621] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:49 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:49.566507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-040b8688-8a1a-49ec-9232-a32626ffcbb7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:49.567108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-040b8688-8a1a-49ec-9232-a32626ffcbb7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:49.573087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-040b8688-8a1a-49ec-9232-a32626ffcbb7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:49.573524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-040b8688-8a1a-49ec-9232-a32626ffcbb7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:49.574263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-040b8688-8a1a-49ec-9232-a32626ffcbb7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:49.574694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-040b8688-8a1a-49ec-9232-a32626ffcbb7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:49.704160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-040b8688-8a1a-49ec-9232-a32626ffcbb7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:49.711526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-040b8688-8a1a-49ec-9232-a32626ffcbb7 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.149273 Jun 27 14:59:49.712079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 372/622] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:49 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:50.229323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:50.229854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:50.236294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:50.236759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:50.237508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:50.237941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:50.267641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:50.268081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:50.268520 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lazy-loading 'fault' on Instance uuid 78e0606f-8bab-4c30-ae7e-82708c23e054 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 14:59:50.311037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150fadafc3944159dfbf11f15bb1ba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773c5d27e2b24590922802937bf9db1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:50.319132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-159f84c3-dd30-489d-9d77-e8b154a143c2 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 200 len: 1304 microversion: 2.1 time: 0.093665 Jun 27 14:59:50.319690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 373/623] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:50 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:50.727127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fe690e23-1d91-4d7c-8721-299caf316e94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:50.727728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fe690e23-1d91-4d7c-8721-299caf316e94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:50.733649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe690e23-1d91-4d7c-8721-299caf316e94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:50.734089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe690e23-1d91-4d7c-8721-299caf316e94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:50.735555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe690e23-1d91-4d7c-8721-299caf316e94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:50.735974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe690e23-1d91-4d7c-8721-299caf316e94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:50.862596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fe690e23-1d91-4d7c-8721-299caf316e94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:50.870016 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fe690e23-1d91-4d7c-8721-299caf316e94 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.146674 Jun 27 14:59:50.870576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 374/624] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:50 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:51.335778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:51.336308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] [instance: 78e0606f-8bab-4c30-ae7e-82708c23e054] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:51.342279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:51.342716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:51.343465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:51.344033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:51.357366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] HTTP exception thrown: Instance 78e0606f-8bab-4c30-ae7e-82708c23e054 could not be found. Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Request method failure captured: Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 HTTP/1.1 Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucWee2qC3Pc4UbYmsCZwwlwx_XHl30YP52ZD-z1YwtiYeCrsodqdfRehCOzBAaLKNT_bwD7X7odH3KTzsuKxqOTnu9HkpqlUsJzH4HmDvgQq7dXFRb1hOqpqWhoXwr_Nhd6qntnH_jLK1_qonGUCsg8kr_Yf41C_6aAYN9kwT0rakcc Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 773c5d27e2b24590922802937bf9db1b Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesNegativeTest-569637405 Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 14:59:51.358860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_773c5d27e2b24590922802937bf9db1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/773c5d27e2b24590922802937bf9db1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/773c5d27e2b24590922802937bf9db1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/773c5d27e2b24590922802937bf9db1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesNegativeTest-569637405 Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 773c5d27e2b24590922802937bf9db1b Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesNegativeTest-569637405 Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesNegativeTest-569637405-project Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: c150fadafc3944159dfbf11f15bb1ba5 Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesNegativeTest-569637405-project Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 78e0606f-8bab-4c30-ae7e-82708c23e054 could not be found. Jun 27 14:59:51.360605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '78e0606f-8bab-4c30-ae7e-82708c23e054'} Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e0606f-8bab-4c30-ae7e-82708c23e054 could not be found. Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 14:59:51.361500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e0606f-8bab-4c30-ae7e-82708c23e054 could not be found. Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e0606f-8bab-4c30-ae7e-82708c23e054 could not be found. Jun 27 14:59:51.362880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 14:59:51.364171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] Returning 404 to user: Instance 78e0606f-8bab-4c30-ae7e-82708c23e054 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 14:59:51.364171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e9dcc396-3b86-4820-994c-ec5835cab2e3 tempest-VolumesNegativeTest-569637405 tempest-VolumesNegativeTest-569637405-project] 10.222.0.44 "GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054" status: 404 len: 111 microversion: 2.1 time: 0.028513 Jun 27 14:59:51.364171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 375/625] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:51 2022] GET /compute/v2.1/servers/78e0606f-8bab-4c30-ae7e-82708c23e054 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 14:59:51.886875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-11e6b9fc-05f0-4746-8223-e0e0e9015b85 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:51.887467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-11e6b9fc-05f0-4746-8223-e0e0e9015b85 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:51.893669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-11e6b9fc-05f0-4746-8223-e0e0e9015b85 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:51.894114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-11e6b9fc-05f0-4746-8223-e0e0e9015b85 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:51.894990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-11e6b9fc-05f0-4746-8223-e0e0e9015b85 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:51.895274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-11e6b9fc-05f0-4746-8223-e0e0e9015b85 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:52.026911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-11e6b9fc-05f0-4746-8223-e0e0e9015b85 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:52.035090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-11e6b9fc-05f0-4746-8223-e0e0e9015b85 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.151947 Jun 27 14:59:52.035644 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 376/626] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:51 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:53.051179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f401acf5-ecd6-46c0-867a-c2a0c83ec681 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:53.051833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f401acf5-ecd6-46c0-867a-c2a0c83ec681 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:53.057878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f401acf5-ecd6-46c0-867a-c2a0c83ec681 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:53.058273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f401acf5-ecd6-46c0-867a-c2a0c83ec681 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:53.059020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f401acf5-ecd6-46c0-867a-c2a0c83ec681 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:53.059455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f401acf5-ecd6-46c0-867a-c2a0c83ec681 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:53.064179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:53.286677 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f401acf5-ecd6-46c0-867a-c2a0c83ec681 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:53.294227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f401acf5-ecd6-46c0-867a-c2a0c83ec681 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.246818 Jun 27 14:59:53.294778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 377/627] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:53 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:53.337963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1115887051", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "networks": [{"uuid": "02214fe4-f4f9-4514-ae46-ea69498e3933"}]}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 14:59:53.388985 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] validate_networks() for [('02214fe4-f4f9-4514-ae46-ea69498e3933', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 14:59:53.745215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 14:59:53.745580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 14:59:53.746050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 14:59:53.746458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 14:59:53.746864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 14:59:53.755725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:53.759869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:53.759869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:53.759869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:53.774611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Getting quotas for project 88f69fa608db4724a066a8dde7efe38a. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 14:59:53.778526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Getting quotas for user e7c4678d1aa9425db97adc6cce76e74f and project 88f69fa608db4724a066a8dde7efe38a. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 14:59:53.790363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 14:59:53.792749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 14:59:53.947140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b7f9d447-3a18-43f5-9154-223b7ea84e46 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613001 Jun 27 14:59:53.949438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 378/628] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 14:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 14:59:53.957902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8c3d4349-a8a4-47b6-a80f-a217401c0a38 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:53.958530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8c3d4349-a8a4-47b6-a80f-a217401c0a38 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:53.960344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:54.024262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8c3d4349-a8a4-47b6-a80f-a217401c0a38 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:54.032077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8c3d4349-a8a4-47b6-a80f-a217401c0a38 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1219 microversion: 2.1 time: 0.077937 Jun 27 14:59:54.032663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 379/629] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:53 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:54.311210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-469eaaf3-eac0-4b5a-8401-e619f7503c36 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:54.311797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-469eaaf3-eac0-4b5a-8401-e619f7503c36 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:54.318672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-469eaaf3-eac0-4b5a-8401-e619f7503c36 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:54.319118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-469eaaf3-eac0-4b5a-8401-e619f7503c36 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:54.319871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-469eaaf3-eac0-4b5a-8401-e619f7503c36 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:54.320330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-469eaaf3-eac0-4b5a-8401-e619f7503c36 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:54.462093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-469eaaf3-eac0-4b5a-8401-e619f7503c36 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:54.470131 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-469eaaf3-eac0-4b5a-8401-e619f7503c36 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.162771 Jun 27 14:59:54.470697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 380/630] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:54 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:55.049250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b1109246-05f7-4bef-9b57-e15bd280cc3c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:55.052537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b1109246-05f7-4bef-9b57-e15bd280cc3c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:55.056234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1109246-05f7-4bef-9b57-e15bd280cc3c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:55.056715 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1109246-05f7-4bef-9b57-e15bd280cc3c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:55.057484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1109246-05f7-4bef-9b57-e15bd280cc3c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:55.057922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1109246-05f7-4bef-9b57-e15bd280cc3c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:55.123975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b1109246-05f7-4bef-9b57-e15bd280cc3c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:55.136185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b1109246-05f7-4bef-9b57-e15bd280cc3c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1223 microversion: 2.1 time: 0.091309 Jun 27 14:59:55.136803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 381/631] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:55 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:55.488795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8a6373ad-8fa1-4976-8c78-510eddc84bae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:55.489418 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8a6373ad-8fa1-4976-8c78-510eddc84bae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:55.495428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8a6373ad-8fa1-4976-8c78-510eddc84bae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:55.495870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8a6373ad-8fa1-4976-8c78-510eddc84bae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:55.496624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8a6373ad-8fa1-4976-8c78-510eddc84bae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:55.497230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8a6373ad-8fa1-4976-8c78-510eddc84bae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:55.631218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8a6373ad-8fa1-4976-8c78-510eddc84bae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:55.638800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8a6373ad-8fa1-4976-8c78-510eddc84bae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.155309 Jun 27 14:59:55.639333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 382/632] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:55 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:56.152848 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f0e13755-4444-4d7e-b2e6-7a8069f64d90 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:56.153448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f0e13755-4444-4d7e-b2e6-7a8069f64d90 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:56.159517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0e13755-4444-4d7e-b2e6-7a8069f64d90 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:56.160008 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0e13755-4444-4d7e-b2e6-7a8069f64d90 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:56.160796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0e13755-4444-4d7e-b2e6-7a8069f64d90 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:56.161222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0e13755-4444-4d7e-b2e6-7a8069f64d90 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:56.220933 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f0e13755-4444-4d7e-b2e6-7a8069f64d90 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:56.228131 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f0e13755-4444-4d7e-b2e6-7a8069f64d90 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1223 microversion: 2.1 time: 0.079282 Jun 27 14:59:56.228701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 383/633] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:56 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:56.655978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-363a9afb-6091-43b4-a626-35b33713f25a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:56.656634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-363a9afb-6091-43b4-a626-35b33713f25a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:56.663392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-363a9afb-6091-43b4-a626-35b33713f25a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:56.663836 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-363a9afb-6091-43b4-a626-35b33713f25a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:56.664578 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-363a9afb-6091-43b4-a626-35b33713f25a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:56.665059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-363a9afb-6091-43b4-a626-35b33713f25a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:56.794832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-363a9afb-6091-43b4-a626-35b33713f25a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:56.802777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-363a9afb-6091-43b4-a626-35b33713f25a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.150694 Jun 27 14:59:56.803328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 384/634] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:56 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:57.245236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e8e3fc25-fd0f-40ab-994b-bd811222871b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:57.245803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e8e3fc25-fd0f-40ab-994b-bd811222871b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:57.252297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8e3fc25-fd0f-40ab-994b-bd811222871b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:57.252762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8e3fc25-fd0f-40ab-994b-bd811222871b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:57.253507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8e3fc25-fd0f-40ab-994b-bd811222871b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:57.253932 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8e3fc25-fd0f-40ab-994b-bd811222871b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:57.313278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e8e3fc25-fd0f-40ab-994b-bd811222871b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:57.320466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e8e3fc25-fd0f-40ab-994b-bd811222871b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1223 microversion: 2.1 time: 0.079268 Jun 27 14:59:57.321050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 385/635] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:57 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:57.819334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bba1cb85-8f8f-4174-b0ae-2d592c25bc06 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:57.819995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bba1cb85-8f8f-4174-b0ae-2d592c25bc06 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:57.826081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bba1cb85-8f8f-4174-b0ae-2d592c25bc06 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:57.826524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bba1cb85-8f8f-4174-b0ae-2d592c25bc06 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:57.827272 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bba1cb85-8f8f-4174-b0ae-2d592c25bc06 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:57.827735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bba1cb85-8f8f-4174-b0ae-2d592c25bc06 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:57.963228 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bba1cb85-8f8f-4174-b0ae-2d592c25bc06 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:57.971932 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bba1cb85-8f8f-4174-b0ae-2d592c25bc06 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.156427 Jun 27 14:59:57.972484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 386/636] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:57 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:58.337806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-237a5b30-f364-4bf5-9acd-d06096eb96c2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:58.338409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-237a5b30-f364-4bf5-9acd-d06096eb96c2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:58.344980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-237a5b30-f364-4bf5-9acd-d06096eb96c2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:58.345472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-237a5b30-f364-4bf5-9acd-d06096eb96c2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:58.346438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-237a5b30-f364-4bf5-9acd-d06096eb96c2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:58.346876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-237a5b30-f364-4bf5-9acd-d06096eb96c2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:58.407427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-237a5b30-f364-4bf5-9acd-d06096eb96c2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:58.414667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-237a5b30-f364-4bf5-9acd-d06096eb96c2 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1223 microversion: 2.1 time: 0.080940 Jun 27 14:59:58.415240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 387/637] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:58 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 14:59:58.989252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-35819f78-52a6-4343-aa4d-30510383c4d8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:58.989970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-35819f78-52a6-4343-aa4d-30510383c4d8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:58.996228 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35819f78-52a6-4343-aa4d-30510383c4d8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:58.996793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35819f78-52a6-4343-aa4d-30510383c4d8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:58.997584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35819f78-52a6-4343-aa4d-30510383c4d8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:58.998017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35819f78-52a6-4343-aa4d-30510383c4d8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:59.141082 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-35819f78-52a6-4343-aa4d-30510383c4d8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:59.148816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-35819f78-52a6-4343-aa4d-30510383c4d8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.164344 Jun 27 14:59:59.149517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 388/638] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:58 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 14:59:59.431510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e76a8210-8235-406b-b706-f6896017ae25 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 14:59:59.432119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e76a8210-8235-406b-b706-f6896017ae25 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 14:59:59.439319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e76a8210-8235-406b-b706-f6896017ae25 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:59.439796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e76a8210-8235-406b-b706-f6896017ae25 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:59.440550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e76a8210-8235-406b-b706-f6896017ae25 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 14:59:59.441011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e76a8210-8235-406b-b706-f6896017ae25 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 14:59:59.530896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e76a8210-8235-406b-b706-f6896017ae25 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 14:59:59.539809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e76a8210-8235-406b-b706-f6896017ae25 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1215 microversion: 2.1 time: 0.112164 Jun 27 14:59:59.540567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 389/639] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 14:59:59 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:00.166596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-743f7779-6a99-477e-80b7-69296691bf9c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:00.168131 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-743f7779-6a99-477e-80b7-69296691bf9c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:00.179169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-743f7779-6a99-477e-80b7-69296691bf9c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:00.184060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-743f7779-6a99-477e-80b7-69296691bf9c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:00.184060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-743f7779-6a99-477e-80b7-69296691bf9c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:00.184060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-743f7779-6a99-477e-80b7-69296691bf9c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:00.344499 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-743f7779-6a99-477e-80b7-69296691bf9c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:00.352557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-743f7779-6a99-477e-80b7-69296691bf9c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.190824 Jun 27 15:00:00.363491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 390/640] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:00 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:00.558126 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0b691d86-2585-4701-9178-12f721085009 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:00.558987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0b691d86-2585-4701-9178-12f721085009 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:00.575263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b691d86-2585-4701-9178-12f721085009 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:00.575263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b691d86-2585-4701-9178-12f721085009 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:00.575263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b691d86-2585-4701-9178-12f721085009 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:00.575263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b691d86-2585-4701-9178-12f721085009 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:00.697109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0b691d86-2585-4701-9178-12f721085009 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:00.714405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0b691d86-2585-4701-9178-12f721085009 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1279 microversion: 2.1 time: 0.160539 Jun 27 15:00:00.716317 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 391/641] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:00 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:01.371038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ec4f4f99-b3ee-4744-9d94-52aab0d036e8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:01.371746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ec4f4f99-b3ee-4744-9d94-52aab0d036e8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:01.384477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ec4f4f99-b3ee-4744-9d94-52aab0d036e8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:01.385308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ec4f4f99-b3ee-4744-9d94-52aab0d036e8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:01.386192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ec4f4f99-b3ee-4744-9d94-52aab0d036e8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:01.386634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ec4f4f99-b3ee-4744-9d94-52aab0d036e8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:01.570722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ec4f4f99-b3ee-4744-9d94-52aab0d036e8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:01.581904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ec4f4f99-b3ee-4744-9d94-52aab0d036e8 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.215376 Jun 27 15:00:01.583446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 392/642] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:01 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:01.739650 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-22bdb3ee-5583-46c7-83fa-97efcee0dcaf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:01.741954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-22bdb3ee-5583-46c7-83fa-97efcee0dcaf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:01.773808 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22bdb3ee-5583-46c7-83fa-97efcee0dcaf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:01.776268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22bdb3ee-5583-46c7-83fa-97efcee0dcaf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:01.776268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22bdb3ee-5583-46c7-83fa-97efcee0dcaf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:01.782519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22bdb3ee-5583-46c7-83fa-97efcee0dcaf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:01.881952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-22bdb3ee-5583-46c7-83fa-97efcee0dcaf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:01.890212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-22bdb3ee-5583-46c7-83fa-97efcee0dcaf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1277 microversion: 2.1 time: 0.155999 Jun 27 15:00:01.901325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 393/643] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:01 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:02.600097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6d3ea21e-102d-4b8a-8dc7-08184b06bca9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:02.602292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6d3ea21e-102d-4b8a-8dc7-08184b06bca9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:02.611910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6d3ea21e-102d-4b8a-8dc7-08184b06bca9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:02.616745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6d3ea21e-102d-4b8a-8dc7-08184b06bca9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:02.619172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6d3ea21e-102d-4b8a-8dc7-08184b06bca9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:02.621751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6d3ea21e-102d-4b8a-8dc7-08184b06bca9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:02.864327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6d3ea21e-102d-4b8a-8dc7-08184b06bca9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:02.879870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6d3ea21e-102d-4b8a-8dc7-08184b06bca9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.284267 Jun 27 15:00:02.881467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 394/644] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:02 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:02.913564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f626e202-d331-4c64-a943-21e85b4e3c65 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:02.914924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f626e202-d331-4c64-a943-21e85b4e3c65 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:02.927847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f626e202-d331-4c64-a943-21e85b4e3c65 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:02.929158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f626e202-d331-4c64-a943-21e85b4e3c65 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:02.930902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f626e202-d331-4c64-a943-21e85b4e3c65 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:02.931583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f626e202-d331-4c64-a943-21e85b4e3c65 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:02.967535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:03.134621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f626e202-d331-4c64-a943-21e85b4e3c65 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:03.145383 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f626e202-d331-4c64-a943-21e85b4e3c65 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.241482 Jun 27 15:00:03.157140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 395/645] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:02 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:03.167262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-c8cfc5b0-f6cd-475c-a108-e03ebdca6dea req-bc4bd77d-da0c-4ec2-be82-df20c47a6661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c8875-88c6-490f-a2a7-b0332d129e3d", "name": "network-vif-plugged", "status": "completed", "tag": "05abf890-aa38-4cf8-b0bb-92c6ba77980d"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:03.177634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-c8cfc5b0-f6cd-475c-a108-e03ebdca6dea req-bc4bd77d-da0c-4ec2-be82-df20c47a6661 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:03.178590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-c8cfc5b0-f6cd-475c-a108-e03ebdca6dea req-bc4bd77d-da0c-4ec2-be82-df20c47a6661 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:03.206304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-c8cfc5b0-f6cd-475c-a108-e03ebdca6dea req-bc4bd77d-da0c-4ec2-be82-df20c47a6661 service nova] Creating event network-vif-plugged:05abf890-aa38-4cf8-b0bb-92c6ba77980d for instance e08c8875-88c6-490f-a2a7-b0332d129e3d on hv-cinder-79760 Jun 27 15:00:03.212332 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-c8cfc5b0-f6cd-475c-a108-e03ebdca6dea req-bc4bd77d-da0c-4ec2-be82-df20c47a6661 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053414 Jun 27 15:00:03.213848 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 396/646] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:00:03.701416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-32827add-c913-4972-a452-207a73a282d8 req-2b7af86d-7534-4ffb-8289-a2ddc8bdb3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3162d971-6d40-49fc-adc7-0f702415b9e6", "tag": "4a0ef132-1922-4203-b6f8-7ab0a4f99254"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:03.739716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-32827add-c913-4972-a452-207a73a282d8 req-2b7af86d-7534-4ffb-8289-a2ddc8bdb3d9 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:03.741734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-32827add-c913-4972-a452-207a73a282d8 req-2b7af86d-7534-4ffb-8289-a2ddc8bdb3d9 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:03.758085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-32827add-c913-4972-a452-207a73a282d8 req-2b7af86d-7534-4ffb-8289-a2ddc8bdb3d9 service nova] Creating event network-changed:4a0ef132-1922-4203-b6f8-7ab0a4f99254 for instance 3162d971-6d40-49fc-adc7-0f702415b9e6 on hv-cinder-79760 Jun 27 15:00:03.765173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-32827add-c913-4972-a452-207a73a282d8 req-2b7af86d-7534-4ffb-8289-a2ddc8bdb3d9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068187 Jun 27 15:00:03.767338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 397/647] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:00:03.902443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e0b14043-353d-444d-a303-b48f10df2a83 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:03.903467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e0b14043-353d-444d-a303-b48f10df2a83 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:03.906859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:03.921228 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e0b14043-353d-444d-a303-b48f10df2a83 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:03.922381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e0b14043-353d-444d-a303-b48f10df2a83 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:03.923360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e0b14043-353d-444d-a303-b48f10df2a83 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:03.927518 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e0b14043-353d-444d-a303-b48f10df2a83 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:04.032072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=8 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:04.115958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e0b14043-353d-444d-a303-b48f10df2a83 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:04.123909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e0b14043-353d-444d-a303-b48f10df2a83 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.228363 Jun 27 15:00:04.124466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 398/648] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:03 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:04.166665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-06e1ad55-a84c-4700-aa97-8c912d01ecc1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:04.168850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-06e1ad55-a84c-4700-aa97-8c912d01ecc1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:04.181492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-06e1ad55-a84c-4700-aa97-8c912d01ecc1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:04.182349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-06e1ad55-a84c-4700-aa97-8c912d01ecc1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:04.183449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-06e1ad55-a84c-4700-aa97-8c912d01ecc1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:04.184336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-06e1ad55-a84c-4700-aa97-8c912d01ecc1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:04.472457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-06e1ad55-a84c-4700-aa97-8c912d01ecc1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:04.482157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-06e1ad55-a84c-4700-aa97-8c912d01ecc1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.324763 Jun 27 15:00:04.483152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 399/649] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:04 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:05.142219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-70fd81fc-51f7-4b22-82cf-751945a7c1cf tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:05.143692 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-70fd81fc-51f7-4b22-82cf-751945a7c1cf tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:05.150497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-70fd81fc-51f7-4b22-82cf-751945a7c1cf tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:05.151185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-70fd81fc-51f7-4b22-82cf-751945a7c1cf tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:05.152144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-70fd81fc-51f7-4b22-82cf-751945a7c1cf tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:05.152766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-70fd81fc-51f7-4b22-82cf-751945a7c1cf tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:05.524968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-70fd81fc-51f7-4b22-82cf-751945a7c1cf tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:05.534950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-70fd81fc-51f7-4b22-82cf-751945a7c1cf tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1259 microversion: 2.1 time: 0.397402 Jun 27 15:00:05.548420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 400/650] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:05 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1259 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:05.559286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-184e61b1-c779-40b6-89c9-37acdc79b9c5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:05.560323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-184e61b1-c779-40b6-89c9-37acdc79b9c5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:05.575200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-184e61b1-c779-40b6-89c9-37acdc79b9c5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:05.578146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-184e61b1-c779-40b6-89c9-37acdc79b9c5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:05.579431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-184e61b1-c779-40b6-89c9-37acdc79b9c5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:05.582172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-184e61b1-c779-40b6-89c9-37acdc79b9c5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:05.885683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-184e61b1-c779-40b6-89c9-37acdc79b9c5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:05.893413 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-184e61b1-c779-40b6-89c9-37acdc79b9c5 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.343646 Jun 27 15:00:05.894520 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 401/651] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:05 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:06.558429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-823ba304-c4b5-4974-bb07-3d1100695c93 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:06.559691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-823ba304-c4b5-4974-bb07-3d1100695c93 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:06.575921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-823ba304-c4b5-4974-bb07-3d1100695c93 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:06.577840 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-823ba304-c4b5-4974-bb07-3d1100695c93 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:06.582863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-823ba304-c4b5-4974-bb07-3d1100695c93 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:06.583787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-823ba304-c4b5-4974-bb07-3d1100695c93 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:07.420444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-823ba304-c4b5-4974-bb07-3d1100695c93 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:07.440477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-823ba304-c4b5-4974-bb07-3d1100695c93 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1443 microversion: 2.1 time: 0.890084 Jun 27 15:00:07.446534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 402/652] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:06 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1443 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:07.451905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8cb756a9-4e7c-4cd3-bed5-e8d2f046f864 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:07.460805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8cb756a9-4e7c-4cd3-bed5-e8d2f046f864 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:07.466429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8cb756a9-4e7c-4cd3-bed5-e8d2f046f864 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:07.467142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8cb756a9-4e7c-4cd3-bed5-e8d2f046f864 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:07.468092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8cb756a9-4e7c-4cd3-bed5-e8d2f046f864 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:07.469375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8cb756a9-4e7c-4cd3-bed5-e8d2f046f864 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:07.764365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8cb756a9-4e7c-4cd3-bed5-e8d2f046f864 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:07.778488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8cb756a9-4e7c-4cd3-bed5-e8d2f046f864 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.329856 Jun 27 15:00:07.779508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 403/653] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:07 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:07.795484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-963a8bf5-8820-4d13-936e-cc74ae93d784 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:07.797540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-963a8bf5-8820-4d13-936e-cc74ae93d784 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:07.807364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-963a8bf5-8820-4d13-936e-cc74ae93d784 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:07.808534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-963a8bf5-8820-4d13-936e-cc74ae93d784 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:07.810355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-963a8bf5-8820-4d13-936e-cc74ae93d784 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:07.810964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-963a8bf5-8820-4d13-936e-cc74ae93d784 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:07.989913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-963a8bf5-8820-4d13-936e-cc74ae93d784 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:08.001681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-963a8bf5-8820-4d13-936e-cc74ae93d784 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1443 microversion: 2.1 time: 0.210778 Jun 27 15:00:08.003441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 404/654] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:07 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1443 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:08.796238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b1098263-f9b3-4d0f-a642-fc7ad71d1a20 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:08.798606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b1098263-f9b3-4d0f-a642-fc7ad71d1a20 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:08.811591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1098263-f9b3-4d0f-a642-fc7ad71d1a20 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:08.813200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1098263-f9b3-4d0f-a642-fc7ad71d1a20 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:08.816191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1098263-f9b3-4d0f-a642-fc7ad71d1a20 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:08.816860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1098263-f9b3-4d0f-a642-fc7ad71d1a20 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:09.090213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b1098263-f9b3-4d0f-a642-fc7ad71d1a20 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:09.113458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b1098263-f9b3-4d0f-a642-fc7ad71d1a20 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.317252 Jun 27 15:00:09.114170 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 405/655] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:08 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:10.130995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c81ebbcb-1fea-4388-8a02-63999479dd07 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:10.133555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c81ebbcb-1fea-4388-8a02-63999479dd07 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:10.142384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c81ebbcb-1fea-4388-8a02-63999479dd07 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:10.143106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c81ebbcb-1fea-4388-8a02-63999479dd07 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:10.144153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c81ebbcb-1fea-4388-8a02-63999479dd07 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:10.144769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c81ebbcb-1fea-4388-8a02-63999479dd07 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:10.418894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c81ebbcb-1fea-4388-8a02-63999479dd07 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:10.428568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c81ebbcb-1fea-4388-8a02-63999479dd07 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.301392 Jun 27 15:00:10.432167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 406/656] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:10 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:11.348386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-a49a6ff3-3e6b-462d-a577-e4fa0798f056 req-027a9f08-ba1d-4ba9-984d-faef74cd7362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08c8875-88c6-490f-a2a7-b0332d129e3d", "tag": "05abf890-aa38-4cf8-b0bb-92c6ba77980d"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:11.357950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-a49a6ff3-3e6b-462d-a577-e4fa0798f056 req-027a9f08-ba1d-4ba9-984d-faef74cd7362 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:11.358769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-a49a6ff3-3e6b-462d-a577-e4fa0798f056 req-027a9f08-ba1d-4ba9-984d-faef74cd7362 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:11.377062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-a49a6ff3-3e6b-462d-a577-e4fa0798f056 req-027a9f08-ba1d-4ba9-984d-faef74cd7362 service nova] Creating event network-changed:05abf890-aa38-4cf8-b0bb-92c6ba77980d for instance e08c8875-88c6-490f-a2a7-b0332d129e3d on hv-cinder-79760 Jun 27 15:00:11.384628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-a49a6ff3-3e6b-462d-a577-e4fa0798f056 req-027a9f08-ba1d-4ba9-984d-faef74cd7362 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045654 Jun 27 15:00:11.390255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 407/657] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 27 15:00:11.448929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-13a27a37-03c9-4f79-a39c-7444e9247140 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:11.449780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-13a27a37-03c9-4f79-a39c-7444e9247140 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:11.462779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13a27a37-03c9-4f79-a39c-7444e9247140 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:11.464184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13a27a37-03c9-4f79-a39c-7444e9247140 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:11.465264 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13a27a37-03c9-4f79-a39c-7444e9247140 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:11.467515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13a27a37-03c9-4f79-a39c-7444e9247140 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:11.701723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-13a27a37-03c9-4f79-a39c-7444e9247140 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:11.715039 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-13a27a37-03c9-4f79-a39c-7444e9247140 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.270886 Jun 27 15:00:11.721522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 408/658] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:11 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:12.735190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ac9a34dc-1f76-4f5c-bb19-7786acfc3eef tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:12.735859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ac9a34dc-1f76-4f5c-bb19-7786acfc3eef tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:12.762025 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac9a34dc-1f76-4f5c-bb19-7786acfc3eef tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:12.769847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac9a34dc-1f76-4f5c-bb19-7786acfc3eef tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:12.773664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac9a34dc-1f76-4f5c-bb19-7786acfc3eef tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:12.774859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac9a34dc-1f76-4f5c-bb19-7786acfc3eef tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:13.031759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ac9a34dc-1f76-4f5c-bb19-7786acfc3eef tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:13.043562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ac9a34dc-1f76-4f5c-bb19-7786acfc3eef tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.314492 Jun 27 15:00:13.045468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 409/659] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:12 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:13.974505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c919c9af-4047-4264-be84-fbafdbb51bbc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:13.975877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c919c9af-4047-4264-be84-fbafdbb51bbc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:13.991650 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c919c9af-4047-4264-be84-fbafdbb51bbc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:13.992470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c919c9af-4047-4264-be84-fbafdbb51bbc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:13.994125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c919c9af-4047-4264-be84-fbafdbb51bbc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:13.994944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c919c9af-4047-4264-be84-fbafdbb51bbc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:14.054774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c919c9af-4047-4264-be84-fbafdbb51bbc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/ips" status: 200 len: 150 microversion: 2.1 time: 0.086431 Jun 27 15:00:14.056617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 410/660] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:00:13 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/ips => generated 150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:00:14.061630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1942ae0b-0f2f-48e7-bd33-cc9d70ccd12d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:14.062644 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1942ae0b-0f2f-48e7-bd33-cc9d70ccd12d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:14.071859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1942ae0b-0f2f-48e7-bd33-cc9d70ccd12d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:14.072745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1942ae0b-0f2f-48e7-bd33-cc9d70ccd12d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:14.074153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1942ae0b-0f2f-48e7-bd33-cc9d70ccd12d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:14.074968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1942ae0b-0f2f-48e7-bd33-cc9d70ccd12d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:14.423938 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1942ae0b-0f2f-48e7-bd33-cc9d70ccd12d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:14.434542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1942ae0b-0f2f-48e7-bd33-cc9d70ccd12d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.376536 Jun 27 15:00:14.437838 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 411/661] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:14 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:15.454426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-20355ef9-5610-40a6-a4d0-cdfd23578506 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:15.455911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-20355ef9-5610-40a6-a4d0-cdfd23578506 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:15.481195 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20355ef9-5610-40a6-a4d0-cdfd23578506 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:15.481760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20355ef9-5610-40a6-a4d0-cdfd23578506 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:15.482853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20355ef9-5610-40a6-a4d0-cdfd23578506 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:15.483512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20355ef9-5610-40a6-a4d0-cdfd23578506 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:15.750164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-20355ef9-5610-40a6-a4d0-cdfd23578506 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:15.758615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-20355ef9-5610-40a6-a4d0-cdfd23578506 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.309614 Jun 27 15:00:15.760149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 412/662] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:15 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:16.229673 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c32a8387-9dcb-43ef-83a5-f4343871d18f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:16.229673 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c32a8387-9dcb-43ef-83a5-f4343871d18f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:16.234648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c32a8387-9dcb-43ef-83a5-f4343871d18f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:16.235211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c32a8387-9dcb-43ef-83a5-f4343871d18f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:16.236054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c32a8387-9dcb-43ef-83a5-f4343871d18f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:16.236561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c32a8387-9dcb-43ef-83a5-f4343871d18f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:16.385185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c32a8387-9dcb-43ef-83a5-f4343871d18f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:16.393773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c32a8387-9dcb-43ef-83a5-f4343871d18f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1517 microversion: 2.1 time: 0.170061 Jun 27 15:00:16.394460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 413/663] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:16 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:16.778348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1477746a-7d0b-4c70-bd6e-a5cab925f5a3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:16.778348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1477746a-7d0b-4c70-bd6e-a5cab925f5a3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:16.793113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1477746a-7d0b-4c70-bd6e-a5cab925f5a3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:16.798229 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1477746a-7d0b-4c70-bd6e-a5cab925f5a3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:16.798229 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1477746a-7d0b-4c70-bd6e-a5cab925f5a3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:16.798229 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1477746a-7d0b-4c70-bd6e-a5cab925f5a3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:16.828392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:16.975892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1477746a-7d0b-4c70-bd6e-a5cab925f5a3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:16.983334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1477746a-7d0b-4c70-bd6e-a5cab925f5a3 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.210965 Jun 27 15:00:16.983966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 414/664] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:16 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:18.000432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f4b8bb2c-b26d-427f-8cab-bd97a9bb2c7b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:18.001433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f4b8bb2c-b26d-427f-8cab-bd97a9bb2c7b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:18.007011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb2c-b26d-427f-8cab-bd97a9bb2c7b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:18.007455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb2c-b26d-427f-8cab-bd97a9bb2c7b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:18.008209 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb2c-b26d-427f-8cab-bd97a9bb2c7b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:18.008635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb2c-b26d-427f-8cab-bd97a9bb2c7b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:18.156770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f4b8bb2c-b26d-427f-8cab-bd97a9bb2c7b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:18.164489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f4b8bb2c-b26d-427f-8cab-bd97a9bb2c7b tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.168531 Jun 27 15:00:18.175195 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 415/665] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:17 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:19.182041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4d9346d3-3df7-41ef-bb42-b08f86c01976 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:19.182656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4d9346d3-3df7-41ef-bb42-b08f86c01976 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:19.194048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d9346d3-3df7-41ef-bb42-b08f86c01976 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:19.194048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d9346d3-3df7-41ef-bb42-b08f86c01976 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:19.194048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d9346d3-3df7-41ef-bb42-b08f86c01976 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:19.194048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d9346d3-3df7-41ef-bb42-b08f86c01976 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:19.429085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4d9346d3-3df7-41ef-bb42-b08f86c01976 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:19.453446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4d9346d3-3df7-41ef-bb42-b08f86c01976 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.274332 Jun 27 15:00:19.454588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 416/666] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:19 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:20.470876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b1a42fa9-2b2b-43f4-be2c-7dd28cbf7554 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:20.472191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b1a42fa9-2b2b-43f4-be2c-7dd28cbf7554 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:20.487027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1a42fa9-2b2b-43f4-be2c-7dd28cbf7554 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:20.487830 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1a42fa9-2b2b-43f4-be2c-7dd28cbf7554 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:20.491132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1a42fa9-2b2b-43f4-be2c-7dd28cbf7554 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:20.491869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1a42fa9-2b2b-43f4-be2c-7dd28cbf7554 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:20.820383 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b1a42fa9-2b2b-43f4-be2c-7dd28cbf7554 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:20.834819 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b1a42fa9-2b2b-43f4-be2c-7dd28cbf7554 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.364279 Jun 27 15:00:20.848217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 417/667] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:20 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:21.668977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ab3641c8-113a-4da9-91ee-2c79ee3c03cd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d702de13-39c0-4732-975e-d5fcda544899"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:21.673605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ab3641c8-113a-4da9-91ee-2c79ee3c03cd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:21.684546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab3641c8-113a-4da9-91ee-2c79ee3c03cd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:21.685434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab3641c8-113a-4da9-91ee-2c79ee3c03cd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:21.686441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab3641c8-113a-4da9-91ee-2c79ee3c03cd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:21.687357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab3641c8-113a-4da9-91ee-2c79ee3c03cd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:22.614867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ab3641c8-113a-4da9-91ee-2c79ee3c03cd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.950452 Jun 27 15:00:22.615506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 418/668] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:00:21 2022] POST /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:00:22.623182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2ff74ca4-3c1d-4bcf-a339-5137f82cfb17 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:22.623892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2ff74ca4-3c1d-4bcf-a339-5137f82cfb17 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:22.644896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ff74ca4-3c1d-4bcf-a339-5137f82cfb17 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:22.652811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ff74ca4-3c1d-4bcf-a339-5137f82cfb17 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:22.653891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ff74ca4-3c1d-4bcf-a339-5137f82cfb17 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:22.654484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2ff74ca4-3c1d-4bcf-a339-5137f82cfb17 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:22.938745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2ff74ca4-3c1d-4bcf-a339-5137f82cfb17 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:22.947005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2ff74ca4-3c1d-4bcf-a339-5137f82cfb17 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.330311 Jun 27 15:00:22.953064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 419/669] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:22 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:22.960196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cc7bf5ca-d2a3-4d08-b13d-739a97a2779e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'create', calling method: .version_select at 0x7f13f9cb5820>, body: {"keypair": {"name": "tempest-keypair-1843497937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2I+H4f8rkOkZK17eiwrjg5nbpHdiYfAjGxqkHN/S4jeBYzvS8IOP4WpFaICjYI+wv1WgeHQa11CBVsNyQnzE0K0o9I72JBMqr+XdXLhjzuKl4lCI6DW7j5n0rCyn7jGg=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:23.003465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-cc7bf5ca-d2a3-4d08-b13d-739a97a2779e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Getting quotas for project c73553ee127a469b9cad0eda54e8c4a2. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:00:23.008207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-cc7bf5ca-d2a3-4d08-b13d-739a97a2779e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Getting quotas for user 27b0e2428571450ea1d5edfd1c3b0f80 and project c73553ee127a469b9cad0eda54e8c4a2. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:00:23.104425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cc7bf5ca-d2a3-4d08-b13d-739a97a2779e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149827 Jun 27 15:00:23.109041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 420/670] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 15:00:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:00:23.969699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5fb232a6-d427-4237-9b37-414a10d71c12 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:23.970426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5fb232a6-d427-4237-9b37-414a10d71c12 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:23.982360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5fb232a6-d427-4237-9b37-414a10d71c12 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:23.994474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5fb232a6-d427-4237-9b37-414a10d71c12 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:23.994474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5fb232a6-d427-4237-9b37-414a10d71c12 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:23.994474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5fb232a6-d427-4237-9b37-414a10d71c12 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:24.340949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5fb232a6-d427-4237-9b37-414a10d71c12 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:24.364324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5fb232a6-d427-4237-9b37-414a10d71c12 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.398073 Jun 27 15:00:24.364713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 421/671] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:23 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:25.381623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e4ecbc2e-5a98-4448-8d04-0af3547b56af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:25.382371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e4ecbc2e-5a98-4448-8d04-0af3547b56af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:25.388156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:25.394030 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc2e-5a98-4448-8d04-0af3547b56af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:25.394490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc2e-5a98-4448-8d04-0af3547b56af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:25.395276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc2e-5a98-4448-8d04-0af3547b56af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:25.395715 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc2e-5a98-4448-8d04-0af3547b56af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:25.666459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e4ecbc2e-5a98-4448-8d04-0af3547b56af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:25.670187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e4ecbc2e-5a98-4448-8d04-0af3547b56af tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.292625 Jun 27 15:00:25.671726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 422/672] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:25 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:26.695322 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4ff16778-1e32-4489-bf6e-249562b39d64 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:26.696847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4ff16778-1e32-4489-bf6e-249562b39d64 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:26.729793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ff16778-1e32-4489-bf6e-249562b39d64 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:26.733497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ff16778-1e32-4489-bf6e-249562b39d64 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:26.735339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ff16778-1e32-4489-bf6e-249562b39d64 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:26.738416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ff16778-1e32-4489-bf6e-249562b39d64 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:27.099926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4ff16778-1e32-4489-bf6e-249562b39d64 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:27.144890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4ff16778-1e32-4489-bf6e-249562b39d64 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.458678 Jun 27 15:00:27.159227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 423/673] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:26 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:27.294620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-4d8e6f20-8ce3-4f90-8961-529645862438 req-bcd13a85-179a-4fe5-8c81-8226a72b971c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3162d971-6d40-49fc-adc7-0f702415b9e6", "name": "network-vif-plugged", "status": "completed", "tag": "4a0ef132-1922-4203-b6f8-7ab0a4f99254"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:27.304191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-4d8e6f20-8ce3-4f90-8961-529645862438 req-bcd13a85-179a-4fe5-8c81-8226a72b971c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:27.310501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-4d8e6f20-8ce3-4f90-8961-529645862438 req-bcd13a85-179a-4fe5-8c81-8226a72b971c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:27.332872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-4d8e6f20-8ce3-4f90-8961-529645862438 req-bcd13a85-179a-4fe5-8c81-8226a72b971c service nova] Creating event network-vif-plugged:4a0ef132-1922-4203-b6f8-7ab0a4f99254 for instance 3162d971-6d40-49fc-adc7-0f702415b9e6 on hv-cinder-79760 Jun 27 15:00:27.357955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-4d8e6f20-8ce3-4f90-8961-529645862438 req-bcd13a85-179a-4fe5-8c81-8226a72b971c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066672 Jun 27 15:00:27.359815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 424/674] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:00:27.673940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-158855650", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "def18f2b-1d12-479c-a792-7c04bf3096cb"}], "security_groups": [{"name": "tempest-securitygroup--631935686"}], "key_name": "tempest-keypair-1843497937", "user_data": "}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:27.818227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] validate_networks() for [('def18f2b-1d12-479c-a792-7c04bf3096cb', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:00:28.356671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:00:28.357118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:00:28.357653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:00:28.357980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:00:28.358917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:00:28.370653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:28.370653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:28.370947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:28.371570 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:28.393837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Getting quotas for project c73553ee127a469b9cad0eda54e8c4a2. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:00:28.401378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Getting quotas for user 27b0e2428571450ea1d5edfd1c3b0f80 and project c73553ee127a469b9cad0eda54e8c4a2. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:00:28.416589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:00:28.419936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:00:28.572041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-80c90a11-b7c9-4be9-8102-4284058589bf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.904009 Jun 27 15:00:28.578222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 425/675] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:00:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:00:28.583274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-59c0e23f-ee3a-4bb8-ac1d-8c19fbfbeddf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:28.584526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-59c0e23f-ee3a-4bb8-ac1d-8c19fbfbeddf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:28.594340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-59c0e23f-ee3a-4bb8-ac1d-8c19fbfbeddf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:28.594795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-59c0e23f-ee3a-4bb8-ac1d-8c19fbfbeddf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:28.595589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-59c0e23f-ee3a-4bb8-ac1d-8c19fbfbeddf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:28.596470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-59c0e23f-ee3a-4bb8-ac1d-8c19fbfbeddf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:28.800526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-59c0e23f-ee3a-4bb8-ac1d-8c19fbfbeddf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:28.809000 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-59c0e23f-ee3a-4bb8-ac1d-8c19fbfbeddf tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.229351 Jun 27 15:00:28.809997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 426/676] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:28 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:28.816960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b4a2acae-56e3-4996-8ed3-12b2340895fa tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:28.817745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b4a2acae-56e3-4996-8ed3-12b2340895fa tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:28.896218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b4a2acae-56e3-4996-8ed3-12b2340895fa tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:28.911781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b4a2acae-56e3-4996-8ed3-12b2340895fa tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1245 microversion: 2.1 time: 0.098291 Jun 27 15:00:28.911781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 427/677] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:28 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:29.826169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b105b191-86e3-4df7-a50d-061c355b9213 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:29.826772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b105b191-86e3-4df7-a50d-061c355b9213 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:29.834276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b105b191-86e3-4df7-a50d-061c355b9213 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:29.834710 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b105b191-86e3-4df7-a50d-061c355b9213 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:29.835451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b105b191-86e3-4df7-a50d-061c355b9213 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:29.835878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b105b191-86e3-4df7-a50d-061c355b9213 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:29.992210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b105b191-86e3-4df7-a50d-061c355b9213 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:30.000172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b105b191-86e3-4df7-a50d-061c355b9213 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1319 microversion: 2.1 time: 0.177774 Jun 27 15:00:30.000774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 428/678] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:29 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:30.005841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2d1049d9-8e8f-474d-a40b-f5d94453ed70 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:30.007530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2d1049d9-8e8f-474d-a40b-f5d94453ed70 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:30.015532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d1049d9-8e8f-474d-a40b-f5d94453ed70 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:30.016085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d1049d9-8e8f-474d-a40b-f5d94453ed70 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:30.016953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d1049d9-8e8f-474d-a40b-f5d94453ed70 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:30.017311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d1049d9-8e8f-474d-a40b-f5d94453ed70 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:30.102327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2d1049d9-8e8f-474d-a40b-f5d94453ed70 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:30.110329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2d1049d9-8e8f-474d-a40b-f5d94453ed70 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1249 microversion: 2.1 time: 0.107790 Jun 27 15:00:30.110445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 429/679] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:30 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1249 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:31.019328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d711a0b5-a98c-4a9f-8456-f794c735cd23 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:31.020036 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d711a0b5-a98c-4a9f-8456-f794c735cd23 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:31.030788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d711a0b5-a98c-4a9f-8456-f794c735cd23 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:31.032230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d711a0b5-a98c-4a9f-8456-f794c735cd23 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:31.033134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d711a0b5-a98c-4a9f-8456-f794c735cd23 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:31.033641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d711a0b5-a98c-4a9f-8456-f794c735cd23 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:31.195252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d711a0b5-a98c-4a9f-8456-f794c735cd23 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:31.202936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d711a0b5-a98c-4a9f-8456-f794c735cd23 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1508 microversion: 2.1 time: 0.187432 Jun 27 15:00:31.203498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 430/680] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:31 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:31.210338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-69ceb29a-b703-49ba-ab29-bba8aee28c52 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:31.210870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-69ceb29a-b703-49ba-ab29-bba8aee28c52 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:31.222497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69ceb29a-b703-49ba-ab29-bba8aee28c52 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:31.222936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69ceb29a-b703-49ba-ab29-bba8aee28c52 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:31.223702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69ceb29a-b703-49ba-ab29-bba8aee28c52 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:31.224129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69ceb29a-b703-49ba-ab29-bba8aee28c52 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:31.301308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-69ceb29a-b703-49ba-ab29-bba8aee28c52 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:31.313238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-69ceb29a-b703-49ba-ab29-bba8aee28c52 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1241 microversion: 2.1 time: 0.108715 Jun 27 15:00:31.314668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 431/681] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:31 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:31.320348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1776dcc2-ac5d-40af-a1b4-af7606ade97d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f35bbce1-afe0-4755-aa0f-34f754c62acc", "device": "/dev/sdb"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:31.321971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1776dcc2-ac5d-40af-a1b4-af7606ade97d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:31.329001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1776dcc2-ac5d-40af-a1b4-af7606ade97d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:31.329191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1776dcc2-ac5d-40af-a1b4-af7606ade97d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:31.330083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1776dcc2-ac5d-40af-a1b4-af7606ade97d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:31.330508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1776dcc2-ac5d-40af-a1b4-af7606ade97d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:31.600451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:32.356941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1776dcc2-ac5d-40af-a1b4-af7606ade97d tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "POST /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.041711 Jun 27 15:00:32.358359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 432/682] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:00:31 2022] POST /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6/os-volume_attachments => generated 194 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:00:32.395621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-19292aba-a8b1-4da9-8262-e3512d1dcc6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:32.396352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-19292aba-a8b1-4da9-8262-e3512d1dcc6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:32.404969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19292aba-a8b1-4da9-8262-e3512d1dcc6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:32.405426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19292aba-a8b1-4da9-8262-e3512d1dcc6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:32.406205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19292aba-a8b1-4da9-8262-e3512d1dcc6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:32.406646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19292aba-a8b1-4da9-8262-e3512d1dcc6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:32.493832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-19292aba-a8b1-4da9-8262-e3512d1dcc6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:32.506542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-19292aba-a8b1-4da9-8262-e3512d1dcc6b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1305 microversion: 2.1 time: 0.146759 Jun 27 15:00:32.507310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 433/683] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:32 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:33.530558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5c234fd1-8f9b-4b12-931f-522f123548d9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:33.531859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5c234fd1-8f9b-4b12-931f-522f123548d9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:33.538925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c234fd1-8f9b-4b12-931f-522f123548d9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:33.539367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c234fd1-8f9b-4b12-931f-522f123548d9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:33.540124 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c234fd1-8f9b-4b12-931f-522f123548d9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:33.540554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c234fd1-8f9b-4b12-931f-522f123548d9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:33.973631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5c234fd1-8f9b-4b12-931f-522f123548d9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:33.985139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5c234fd1-8f9b-4b12-931f-522f123548d9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.458717 Jun 27 15:00:33.986867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 434/684] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:33 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:35.011013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1f1c1123-f092-4f41-9ec0-e65c2d1fee8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:35.014691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1f1c1123-f092-4f41-9ec0-e65c2d1fee8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:35.029138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f1c1123-f092-4f41-9ec0-e65c2d1fee8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:35.030739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f1c1123-f092-4f41-9ec0-e65c2d1fee8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:35.049535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f1c1123-f092-4f41-9ec0-e65c2d1fee8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:35.050004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1f1c1123-f092-4f41-9ec0-e65c2d1fee8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:35.278911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1f1c1123-f092-4f41-9ec0-e65c2d1fee8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:35.286600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1f1c1123-f092-4f41-9ec0-e65c2d1fee8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.287210 Jun 27 15:00:35.287199 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 435/685] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:34 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:35.335267 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a9d6e6a8-b798-4d93-81fa-6e27f006f5aa tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Action: 'create', calling method: .version_select at 0x7f13fe2b7c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1787073673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrxnUDTR/NZ3xOsLqdgC08ZLYOLYXucQJbCDyqg0ux+R3Z2wiUpQihqwiK7zvTNIAjclIsglZJpKv3lkXoJX1LxcoQGDS0LqTN9T1E0K+LOFRh0ngk9xIRtRQQqtXW+WQ=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:35.349325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-a9d6e6a8-b798-4d93-81fa-6e27f006f5aa tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Getting quotas for project 51e6f52c6a854f65aaa7f0a3f706c83c. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:00:35.353792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-a9d6e6a8-b798-4d93-81fa-6e27f006f5aa tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Getting quotas for user e03bcfa7f95d4266ac02a457e14d0c01 and project 51e6f52c6a854f65aaa7f0a3f706c83c. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:00:35.465111 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a9d6e6a8-b798-4d93-81fa-6e27f006f5aa tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.134211 Jun 27 15:00:35.466224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 436/686] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 15:00:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:00:35.473895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-73d6e9a8-5ea7-47d3-af6e-c2ace345ae2b req-004e22e0-9967-403f-bd47-2c63aef530be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c", "tag": "059a8345-bdf4-4361-bf2e-05650504b384"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:35.487762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-73d6e9a8-5ea7-47d3-af6e-c2ace345ae2b req-004e22e0-9967-403f-bd47-2c63aef530be service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:35.488547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-73d6e9a8-5ea7-47d3-af6e-c2ace345ae2b req-004e22e0-9967-403f-bd47-2c63aef530be service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:35.524891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-73d6e9a8-5ea7-47d3-af6e-c2ace345ae2b req-004e22e0-9967-403f-bd47-2c63aef530be service nova] Creating event network-changed:059a8345-bdf4-4361-bf2e-05650504b384 for instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c on hv-cinder-79760 Jun 27 15:00:35.536216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-73d6e9a8-5ea7-47d3-af6e-c2ace345ae2b req-004e22e0-9967-403f-bd47-2c63aef530be service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068390 Jun 27 15:00:35.539160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 437/687] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:00:35.644256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1548697053", "imageRef": "d6785df9-68db-410a-8909-8bf9478fde88", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1787073673", "networks": [{"uuid": "fa9ee7b4-138f-4f76-9ebc-18847b56aaa2"}]}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:35.714141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] validate_networks() for [('fa9ee7b4-138f-4f76-9ebc-18847b56aaa2', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:00:36.237335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:00:36.237998 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:00:36.238415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:00:36.238818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:00:36.239219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:00:36.261584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:36.261584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:36.261584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:36.261584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:36.270651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Getting quotas for project 51e6f52c6a854f65aaa7f0a3f706c83c. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:00:36.275456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Getting quotas for user e03bcfa7f95d4266ac02a457e14d0c01 and project 51e6f52c6a854f65aaa7f0a3f706c83c. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:00:36.289828 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:00:36.292231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6785df9-68db-410a-8909-8bf9478fde88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:00:36.409692 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-93e78c05-f082-45f5-a23e-9c6b50fad1e4 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769838 Jun 27 15:00:36.411753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 438/688] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:00:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:00:36.416120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0d9162ec-6b4b-4923-80d8-2f368e5cf244 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: .version_select at 0x7f13fe2ecee0>, body: {"keypair": {"name": "tempest-keypair-1771443822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5DSF5aFgLlegYfAf8tpDEg+VhUPta6zhPXmuxj2RkbyAJfNTfBPrvNFpac7sbYYe8EeWaSJqlnnH0mGLasiLq7SsH5ZnpM7puu1KkvJMJK1cPZua93IoXRZusGMoCz/g=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:36.432744 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-0d9162ec-6b4b-4923-80d8-2f368e5cf244 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for project 3d96ee908883411d9838f850ee7dd66b. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:00:36.436621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-0d9162ec-6b4b-4923-80d8-2f368e5cf244 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for user d93abd4361d240919ec85cf4b92347fb and project 3d96ee908883411d9838f850ee7dd66b. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:00:36.520739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0d9162ec-6b4b-4923-80d8-2f368e5cf244 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104321 Jun 27 15:00:36.520739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 439/689] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 15:00:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:00:36.525281 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fb76b7e3-4821-4ac5-b6ed-951e0e86d96c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:36.526063 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fb76b7e3-4821-4ac5-b6ed-951e0e86d96c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:36.536201 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb76b7e3-4821-4ac5-b6ed-951e0e86d96c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:36.536827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb76b7e3-4821-4ac5-b6ed-951e0e86d96c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:36.538273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb76b7e3-4821-4ac5-b6ed-951e0e86d96c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:36.538753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb76b7e3-4821-4ac5-b6ed-951e0e86d96c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:36.677809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fb76b7e3-4821-4ac5-b6ed-951e0e86d96c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:36.685660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fb76b7e3-4821-4ac5-b6ed-951e0e86d96c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.168137 Jun 27 15:00:36.686232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 440/690] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:36 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:36.690988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6e96f9a0-9c91-4c79-88d0-7d10bd6bc6a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:36.691616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6e96f9a0-9c91-4c79-88d0-7d10bd6bc6a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:36.757047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6e96f9a0-9c91-4c79-88d0-7d10bd6bc6a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:36.763763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6e96f9a0-9c91-4c79-88d0-7d10bd6bc6a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1259 microversion: 2.1 time: 0.076335 Jun 27 15:00:36.764326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 441/691] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:36 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:37.703340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4db9f64f-6a2f-4dbf-917b-5dfd43678ce6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:37.703953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4db9f64f-6a2f-4dbf-917b-5dfd43678ce6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:37.711173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4db9f64f-6a2f-4dbf-917b-5dfd43678ce6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:37.711614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4db9f64f-6a2f-4dbf-917b-5dfd43678ce6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:37.712361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4db9f64f-6a2f-4dbf-917b-5dfd43678ce6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:37.713027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4db9f64f-6a2f-4dbf-917b-5dfd43678ce6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:37.845329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4db9f64f-6a2f-4dbf-917b-5dfd43678ce6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:37.852918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4db9f64f-6a2f-4dbf-917b-5dfd43678ce6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.153395 Jun 27 15:00:37.853477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 442/692] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:37 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:37.857863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5ae5329a-83ee-4e64-8075-3884f62c6986 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:37.858453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5ae5329a-83ee-4e64-8075-3884f62c6986 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:37.864021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ae5329a-83ee-4e64-8075-3884f62c6986 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:37.864456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ae5329a-83ee-4e64-8075-3884f62c6986 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:37.865234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ae5329a-83ee-4e64-8075-3884f62c6986 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:37.865659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ae5329a-83ee-4e64-8075-3884f62c6986 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:37.927512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5ae5329a-83ee-4e64-8075-3884f62c6986 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:37.935473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5ae5329a-83ee-4e64-8075-3884f62c6986 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1263 microversion: 2.1 time: 0.081039 Jun 27 15:00:37.936119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 443/693] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:37 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:38.869038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0f653a88-cbdf-4571-adf0-ce9723925c9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:38.869654 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0f653a88-cbdf-4571-adf0-ce9723925c9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:38.872033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:38.876777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f653a88-cbdf-4571-adf0-ce9723925c9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:38.877224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f653a88-cbdf-4571-adf0-ce9723925c9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:38.877979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f653a88-cbdf-4571-adf0-ce9723925c9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:38.878407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f653a88-cbdf-4571-adf0-ce9723925c9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:39.013959 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0f653a88-cbdf-4571-adf0-ce9723925c9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:39.022088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0f653a88-cbdf-4571-adf0-ce9723925c9c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.156421 Jun 27 15:00:39.026379 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 444/694] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:38 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:39.028055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e3541cff-7b42-4d1b-ae72-dd847cfa1ce7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:39.028683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e3541cff-7b42-4d1b-ae72-dd847cfa1ce7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:39.034534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e3541cff-7b42-4d1b-ae72-dd847cfa1ce7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:39.034987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e3541cff-7b42-4d1b-ae72-dd847cfa1ce7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:39.035743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e3541cff-7b42-4d1b-ae72-dd847cfa1ce7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:39.036179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e3541cff-7b42-4d1b-ae72-dd847cfa1ce7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:39.097355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e3541cff-7b42-4d1b-ae72-dd847cfa1ce7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:39.105226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e3541cff-7b42-4d1b-ae72-dd847cfa1ce7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1263 microversion: 2.1 time: 0.081053 Jun 27 15:00:39.105800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 445/695] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:39 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:39.110767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1715854338", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a5eed5b-e23d-40b2-b9c3-11f70e365ab5"}], "security_groups": [{"name": "tempest-securitygroup--1444964000"}], "key_name": "tempest-keypair-1771443822", "user_data": "}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:39.208163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] validate_networks() for [('5a5eed5b-e23d-40b2-b9c3-11f70e365ab5', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:00:39.572176 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:00:39.572588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:00:39.573084 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:00:39.573487 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:00:39.573892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:00:39.582335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:39.582775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:39.583563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:39.584554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:39.601161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for project 3d96ee908883411d9838f850ee7dd66b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:00:39.604793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for user d93abd4361d240919ec85cf4b92347fb and project 3d96ee908883411d9838f850ee7dd66b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:00:39.615194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:00:39.617433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:00:39.769259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d2231174-7b3d-4a8e-8175-3325dd66a792 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.662387 Jun 27 15:00:39.770015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 446/696] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:00:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:00:39.780360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8e7f4fc6-66ad-4495-b17c-148c63e97719 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:39.781004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8e7f4fc6-66ad-4495-b17c-148c63e97719 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:39.838482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8e7f4fc6-66ad-4495-b17c-148c63e97719 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:39.842959 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8e7f4fc6-66ad-4495-b17c-148c63e97719 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1242 microversion: 2.1 time: 0.066412 Jun 27 15:00:39.843656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 447/697] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:39 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:40.039797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-40dfece0-1c05-478e-b80c-d57bc4c729f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:40.040513 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-40dfece0-1c05-478e-b80c-d57bc4c729f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:40.047566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40dfece0-1c05-478e-b80c-d57bc4c729f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:40.048011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40dfece0-1c05-478e-b80c-d57bc4c729f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:40.048792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40dfece0-1c05-478e-b80c-d57bc4c729f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:40.049220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40dfece0-1c05-478e-b80c-d57bc4c729f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:40.182779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-40dfece0-1c05-478e-b80c-d57bc4c729f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:40.190455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-40dfece0-1c05-478e-b80c-d57bc4c729f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.154934 Jun 27 15:00:40.191015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 448/698] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:40 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:40.196276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e4d60a68-3f15-4bd3-aba8-b3a18ace8882 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:40.197108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e4d60a68-3f15-4bd3-aba8-b3a18ace8882 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:40.203275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4d60a68-3f15-4bd3-aba8-b3a18ace8882 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:40.203732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4d60a68-3f15-4bd3-aba8-b3a18ace8882 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:40.204491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4d60a68-3f15-4bd3-aba8-b3a18ace8882 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:40.204963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4d60a68-3f15-4bd3-aba8-b3a18ace8882 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:40.275400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e4d60a68-3f15-4bd3-aba8-b3a18ace8882 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:40.282769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e4d60a68-3f15-4bd3-aba8-b3a18ace8882 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1255 microversion: 2.1 time: 0.090733 Jun 27 15:00:40.283418 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 449/699] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:40 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1255 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:40.861498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cec819c4-b1c4-4c11-9dc5-8a32016bf7b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:40.862132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cec819c4-b1c4-4c11-9dc5-8a32016bf7b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:40.869518 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cec819c4-b1c4-4c11-9dc5-8a32016bf7b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:40.869957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cec819c4-b1c4-4c11-9dc5-8a32016bf7b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:40.872227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cec819c4-b1c4-4c11-9dc5-8a32016bf7b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:40.873792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cec819c4-b1c4-4c11-9dc5-8a32016bf7b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:40.953616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cec819c4-b1c4-4c11-9dc5-8a32016bf7b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:40.961744 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cec819c4-b1c4-4c11-9dc5-8a32016bf7b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1246 microversion: 2.1 time: 0.105758 Jun 27 15:00:40.975465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 450/700] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:40 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:41.207479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f0052654-0425-4359-bbdc-846e6dc0b2c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:41.208192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f0052654-0425-4359-bbdc-846e6dc0b2c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:41.222323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0052654-0425-4359-bbdc-846e6dc0b2c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:41.223037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0052654-0425-4359-bbdc-846e6dc0b2c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:41.224021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0052654-0425-4359-bbdc-846e6dc0b2c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:41.224771 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0052654-0425-4359-bbdc-846e6dc0b2c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:41.400451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f0052654-0425-4359-bbdc-846e6dc0b2c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:41.407951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f0052654-0425-4359-bbdc-846e6dc0b2c9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.204356 Jun 27 15:00:41.408994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 451/701] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:41 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:41.413662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e337abff-71ce-4c64-b13c-e2168b9acbaf tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:41.414261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e337abff-71ce-4c64-b13c-e2168b9acbaf tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:41.420015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e337abff-71ce-4c64-b13c-e2168b9acbaf tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:41.420458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e337abff-71ce-4c64-b13c-e2168b9acbaf tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:41.421260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e337abff-71ce-4c64-b13c-e2168b9acbaf tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:41.421692 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e337abff-71ce-4c64-b13c-e2168b9acbaf tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:41.489031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e337abff-71ce-4c64-b13c-e2168b9acbaf tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:41.498331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e337abff-71ce-4c64-b13c-e2168b9acbaf tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1319 microversion: 2.1 time: 0.088773 Jun 27 15:00:41.499108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 452/702] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:41 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1319 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:41.979448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f3995225-2bcb-4dbc-a3c8-15f043e6658a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:41.980060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f3995225-2bcb-4dbc-a3c8-15f043e6658a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:41.987033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3995225-2bcb-4dbc-a3c8-15f043e6658a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:41.987033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3995225-2bcb-4dbc-a3c8-15f043e6658a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:41.987931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3995225-2bcb-4dbc-a3c8-15f043e6658a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:41.988360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3995225-2bcb-4dbc-a3c8-15f043e6658a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:42.074458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f3995225-2bcb-4dbc-a3c8-15f043e6658a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:42.084021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f3995225-2bcb-4dbc-a3c8-15f043e6658a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1294 microversion: 2.1 time: 0.108346 Jun 27 15:00:42.085204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 453/703] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:41 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1294 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:42.425849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1d381a00-6dfe-4106-9085-2d87bf7f64c3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:42.426540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1d381a00-6dfe-4106-9085-2d87bf7f64c3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:42.433074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d381a00-6dfe-4106-9085-2d87bf7f64c3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:42.433517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d381a00-6dfe-4106-9085-2d87bf7f64c3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:42.434268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d381a00-6dfe-4106-9085-2d87bf7f64c3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:42.434695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d381a00-6dfe-4106-9085-2d87bf7f64c3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:42.452796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:42.565952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1d381a00-6dfe-4106-9085-2d87bf7f64c3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:42.573477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1d381a00-6dfe-4106-9085-2d87bf7f64c3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.151495 Jun 27 15:00:42.574039 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 454/704] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:42 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:42.578395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5476a82f-75b8-45f3-9cdb-d8882065d6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:42.578988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5476a82f-75b8-45f3-9cdb-d8882065d6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:42.585117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5476a82f-75b8-45f3-9cdb-d8882065d6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:42.585557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5476a82f-75b8-45f3-9cdb-d8882065d6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:42.586331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5476a82f-75b8-45f3-9cdb-d8882065d6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:42.586761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5476a82f-75b8-45f3-9cdb-d8882065d6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:42.715017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5476a82f-75b8-45f3-9cdb-d8882065d6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:42.722599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5476a82f-75b8-45f3-9cdb-d8882065d6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.147600 Jun 27 15:00:42.723155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 455/705] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:42 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:42.803348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-6a9dfaf8-4ff2-4d41-a9b8-0d1d446cc327 req-0d980d8e-9e80-4aec-bad8-28903100d794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c", "name": "network-vif-plugged", "status": "completed", "tag": "059a8345-bdf4-4361-bf2e-05650504b384"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:42.812223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6a9dfaf8-4ff2-4d41-a9b8-0d1d446cc327 req-0d980d8e-9e80-4aec-bad8-28903100d794 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:42.812682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6a9dfaf8-4ff2-4d41-a9b8-0d1d446cc327 req-0d980d8e-9e80-4aec-bad8-28903100d794 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:42.824108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-6a9dfaf8-4ff2-4d41-a9b8-0d1d446cc327 req-0d980d8e-9e80-4aec-bad8-28903100d794 service nova] Creating event network-vif-plugged:059a8345-bdf4-4361-bf2e-05650504b384 for instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c on hv-cinder-79760 Jun 27 15:00:42.830060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-6a9dfaf8-4ff2-4d41-a9b8-0d1d446cc327 req-0d980d8e-9e80-4aec-bad8-28903100d794 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 Jun 27 15:00:42.832889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 456/706] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:00:43.116394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-73a0b816-6c97-4024-9bd9-632c1ade6985 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:43.123633 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-73a0b816-6c97-4024-9bd9-632c1ade6985 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:43.140974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73a0b816-6c97-4024-9bd9-632c1ade6985 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:43.141463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73a0b816-6c97-4024-9bd9-632c1ade6985 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:43.145880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73a0b816-6c97-4024-9bd9-632c1ade6985 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:43.146965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73a0b816-6c97-4024-9bd9-632c1ade6985 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:43.259913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-73a0b816-6c97-4024-9bd9-632c1ade6985 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:43.271636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-73a0b816-6c97-4024-9bd9-632c1ade6985 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1302 microversion: 2.1 time: 0.173637 Jun 27 15:00:43.272586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 457/707] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:43 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:43.593952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9dcf764e-a4c0-465a-b346-f3dc65913d2c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:43.595586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9dcf764e-a4c0-465a-b346-f3dc65913d2c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:43.604713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dcf764e-a4c0-465a-b346-f3dc65913d2c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:43.605651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dcf764e-a4c0-465a-b346-f3dc65913d2c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:43.606825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dcf764e-a4c0-465a-b346-f3dc65913d2c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:43.607834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dcf764e-a4c0-465a-b346-f3dc65913d2c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:43.791712 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9dcf764e-a4c0-465a-b346-f3dc65913d2c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:43.805604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9dcf764e-a4c0-465a-b346-f3dc65913d2c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.212906 Jun 27 15:00:43.805604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 458/708] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:43 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:43.812771 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fdc6603d-0673-4c85-a119-71f021a280ec tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:43.813640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fdc6603d-0673-4c85-a119-71f021a280ec tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:43.822274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fdc6603d-0673-4c85-a119-71f021a280ec tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:43.822774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fdc6603d-0673-4c85-a119-71f021a280ec tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:43.823555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fdc6603d-0673-4c85-a119-71f021a280ec tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:43.823990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fdc6603d-0673-4c85-a119-71f021a280ec tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:44.012251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fdc6603d-0673-4c85-a119-71f021a280ec tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:44.021768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fdc6603d-0673-4c85-a119-71f021a280ec tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.219888 Jun 27 15:00:44.022504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 459/709] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:43 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:44.027526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-cb7efc7b-077e-4fa3-8bd3-39ec744fc925 req-9b5c546c-27b3-4bf5-b790-c5e8c17d6a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f21014-5688-42b2-990a-51b99ff11e91", "tag": "53878d21-1d99-4fed-a685-f691228ebaa2"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:44.036251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-cb7efc7b-077e-4fa3-8bd3-39ec744fc925 req-9b5c546c-27b3-4bf5-b790-c5e8c17d6a04 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:44.036962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-cb7efc7b-077e-4fa3-8bd3-39ec744fc925 req-9b5c546c-27b3-4bf5-b790-c5e8c17d6a04 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:44.053048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-cb7efc7b-077e-4fa3-8bd3-39ec744fc925 req-9b5c546c-27b3-4bf5-b790-c5e8c17d6a04 service nova] Creating event network-changed:53878d21-1d99-4fed-a685-f691228ebaa2 for instance c2f21014-5688-42b2-990a-51b99ff11e91 on hv-cinder-79760 Jun 27 15:00:44.063821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-cb7efc7b-077e-4fa3-8bd3-39ec744fc925 req-9b5c546c-27b3-4bf5-b790-c5e8c17d6a04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039247 Jun 27 15:00:44.067627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 460/710] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:00:44.290543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c0d6995b-2dfa-4614-b7ea-04ac640968fb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:44.291231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c0d6995b-2dfa-4614-b7ea-04ac640968fb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:44.297531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c0d6995b-2dfa-4614-b7ea-04ac640968fb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:44.297973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c0d6995b-2dfa-4614-b7ea-04ac640968fb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:44.298723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c0d6995b-2dfa-4614-b7ea-04ac640968fb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:44.299154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c0d6995b-2dfa-4614-b7ea-04ac640968fb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:44.377355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c0d6995b-2dfa-4614-b7ea-04ac640968fb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:44.385664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c0d6995b-2dfa-4614-b7ea-04ac640968fb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.100029 Jun 27 15:00:44.386436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 461/711] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:44 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:44.818029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b7f7ed34-f4f5-42db-aa91-e208f0f8a7ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:44.818725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b7f7ed34-f4f5-42db-aa91-e208f0f8a7ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:44.825181 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7f7ed34-f4f5-42db-aa91-e208f0f8a7ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:44.825628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7f7ed34-f4f5-42db-aa91-e208f0f8a7ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:44.826383 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7f7ed34-f4f5-42db-aa91-e208f0f8a7ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:44.826816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7f7ed34-f4f5-42db-aa91-e208f0f8a7ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:44.979850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b7f7ed34-f4f5-42db-aa91-e208f0f8a7ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:44.987474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b7f7ed34-f4f5-42db-aa91-e208f0f8a7ef tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.173335 Jun 27 15:00:44.988037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 462/712] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:44 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:45.049665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-811f80e6-fd3d-422e-87d8-d971e7d94e2b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:45.050426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-811f80e6-fd3d-422e-87d8-d971e7d94e2b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:45.056970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-811f80e6-fd3d-422e-87d8-d971e7d94e2b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:45.057469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-811f80e6-fd3d-422e-87d8-d971e7d94e2b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:45.063559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-811f80e6-fd3d-422e-87d8-d971e7d94e2b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:45.063559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-811f80e6-fd3d-422e-87d8-d971e7d94e2b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:45.192812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-811f80e6-fd3d-422e-87d8-d971e7d94e2b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:45.209423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-811f80e6-fd3d-422e-87d8-d971e7d94e2b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.156547 Jun 27 15:00:45.209423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 463/713] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:45 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:45.221447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7cda9797-e15c-4d56-b810-c6450d76c640 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:45.222178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7cda9797-e15c-4d56-b810-c6450d76c640 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:45.229225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7cda9797-e15c-4d56-b810-c6450d76c640 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:45.229604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7cda9797-e15c-4d56-b810-c6450d76c640 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:45.230372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7cda9797-e15c-4d56-b810-c6450d76c640 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:45.230841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7cda9797-e15c-4d56-b810-c6450d76c640 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:45.255134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7cda9797-e15c-4d56-b810-c6450d76c640 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/ips" status: 200 len: 152 microversion: 2.20 time: 0.037722 Jun 27 15:00:45.256604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 464/714] 10.222.0.44 () {60 vars in 1288 bytes} [Mon Jun 27 15:00:45 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:00:45.403257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0f8ce623-82d0-4ed1-bf66-37db0ddd60cc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:45.403867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0f8ce623-82d0-4ed1-bf66-37db0ddd60cc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:45.409912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f8ce623-82d0-4ed1-bf66-37db0ddd60cc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:45.410354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f8ce623-82d0-4ed1-bf66-37db0ddd60cc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:45.411108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f8ce623-82d0-4ed1-bf66-37db0ddd60cc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:45.411572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f8ce623-82d0-4ed1-bf66-37db0ddd60cc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:45.476147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0f8ce623-82d0-4ed1-bf66-37db0ddd60cc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:45.485086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0f8ce623-82d0-4ed1-bf66-37db0ddd60cc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.085702 Jun 27 15:00:45.486072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 465/715] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:45 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:46.006261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b7fc2662-a0ac-4f2b-8033-89db94cbea8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:46.007027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b7fc2662-a0ac-4f2b-8033-89db94cbea8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:46.017950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7fc2662-a0ac-4f2b-8033-89db94cbea8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:46.019638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7fc2662-a0ac-4f2b-8033-89db94cbea8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:46.019638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7fc2662-a0ac-4f2b-8033-89db94cbea8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:46.019837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b7fc2662-a0ac-4f2b-8033-89db94cbea8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:46.166488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b7fc2662-a0ac-4f2b-8033-89db94cbea8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:46.174678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b7fc2662-a0ac-4f2b-8033-89db94cbea8f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.172884 Jun 27 15:00:46.175243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 466/716] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:46 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:46.220432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-62dca145-fa66-43d0-abe8-be03b41d1bdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:46.222642 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-62dca145-fa66-43d0-abe8-be03b41d1bdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:46.226915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62dca145-fa66-43d0-abe8-be03b41d1bdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:46.227453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62dca145-fa66-43d0-abe8-be03b41d1bdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:46.228107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62dca145-fa66-43d0-abe8-be03b41d1bdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:46.228535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62dca145-fa66-43d0-abe8-be03b41d1bdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:46.359947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-62dca145-fa66-43d0-abe8-be03b41d1bdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:46.368605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-62dca145-fa66-43d0-abe8-be03b41d1bdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.151909 Jun 27 15:00:46.369520 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 467/717] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:46 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:46.502293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b4e75058-cddf-4cdf-8102-23ff9f9c9f8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:46.502900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b4e75058-cddf-4cdf-8102-23ff9f9c9f8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:46.509730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4e75058-cddf-4cdf-8102-23ff9f9c9f8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:46.510177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4e75058-cddf-4cdf-8102-23ff9f9c9f8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:46.510940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4e75058-cddf-4cdf-8102-23ff9f9c9f8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:46.511375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4e75058-cddf-4cdf-8102-23ff9f9c9f8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:46.573538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b4e75058-cddf-4cdf-8102-23ff9f9c9f8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:46.580909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b4e75058-cddf-4cdf-8102-23ff9f9c9f8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.082511 Jun 27 15:00:46.581472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 468/718] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:46 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:47.192436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0dbff351-36a7-4563-bdd9-a977736900f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:47.193273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0dbff351-36a7-4563-bdd9-a977736900f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:47.199797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0dbff351-36a7-4563-bdd9-a977736900f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:47.200239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0dbff351-36a7-4563-bdd9-a977736900f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:47.201009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0dbff351-36a7-4563-bdd9-a977736900f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:47.201440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0dbff351-36a7-4563-bdd9-a977736900f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:47.338038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0dbff351-36a7-4563-bdd9-a977736900f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:47.346993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0dbff351-36a7-4563-bdd9-a977736900f7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.158228 Jun 27 15:00:47.347916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 469/719] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:47 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:47.386147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fa844e82-793f-4bba-a030-e97acd1a3efd tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:47.389996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fa844e82-793f-4bba-a030-e97acd1a3efd tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:47.392926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fa844e82-793f-4bba-a030-e97acd1a3efd tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:47.393375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fa844e82-793f-4bba-a030-e97acd1a3efd tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:47.394137 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fa844e82-793f-4bba-a030-e97acd1a3efd tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:47.394571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fa844e82-793f-4bba-a030-e97acd1a3efd tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:47.525845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fa844e82-793f-4bba-a030-e97acd1a3efd tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:47.533172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fa844e82-793f-4bba-a030-e97acd1a3efd tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.150888 Jun 27 15:00:47.533761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 470/720] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:47 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:47.597779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-138d1015-19ad-4eb4-a541-2531548aa469 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:47.598706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-138d1015-19ad-4eb4-a541-2531548aa469 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:47.606028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-138d1015-19ad-4eb4-a541-2531548aa469 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:47.606630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-138d1015-19ad-4eb4-a541-2531548aa469 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:47.607510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-138d1015-19ad-4eb4-a541-2531548aa469 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:47.608064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-138d1015-19ad-4eb4-a541-2531548aa469 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:47.674459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-138d1015-19ad-4eb4-a541-2531548aa469 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:47.682772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-138d1015-19ad-4eb4-a541-2531548aa469 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.089021 Jun 27 15:00:47.683336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 471/721] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:47 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:48.370474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-13582ac0-567c-42e0-ae3f-9f82d267fbc9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:48.370474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-13582ac0-567c-42e0-ae3f-9f82d267fbc9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:48.375313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13582ac0-567c-42e0-ae3f-9f82d267fbc9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:48.375816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13582ac0-567c-42e0-ae3f-9f82d267fbc9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:48.376790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13582ac0-567c-42e0-ae3f-9f82d267fbc9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:48.377430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13582ac0-567c-42e0-ae3f-9f82d267fbc9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:48.520272 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-13582ac0-567c-42e0-ae3f-9f82d267fbc9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:48.524852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:48.529982 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-13582ac0-567c-42e0-ae3f-9f82d267fbc9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.168295 Jun 27 15:00:48.530857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 472/722] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:48 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:48.537877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d09b8271-2fa4-4e45-9cf2-8a4673cbdeef tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:00:48.538436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d09b8271-2fa4-4e45-9cf2-8a4673cbdeef tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:48.545555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d09b8271-2fa4-4e45-9cf2-8a4673cbdeef tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:48.546029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d09b8271-2fa4-4e45-9cf2-8a4673cbdeef tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:48.546811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d09b8271-2fa4-4e45-9cf2-8a4673cbdeef tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:48.547242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d09b8271-2fa4-4e45-9cf2-8a4673cbdeef tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:48.569553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-d09b8271-2fa4-4e45-9cf2-8a4673cbdeef tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lazy-loading 'flavor' on Instance uuid d67eac8a-bfba-489d-8d6d-11956e1b4e90 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:00:49.117716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d09b8271-2fa4-4e45-9cf2-8a4673cbdeef tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/action" status: 202 len: 0 microversion: 2.20 time: 0.584714 Jun 27 15:00:49.118386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 473/723] 10.222.0.44 () {62 vars in 1318 bytes} [Mon Jun 27 15:00:48 2022] POST /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:00:49.123635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-952d7479-5be5-4ee5-a04b-11bb45222833 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:49.124319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-952d7479-5be5-4ee5-a04b-11bb45222833 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:49.130826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-952d7479-5be5-4ee5-a04b-11bb45222833 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:49.131306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-952d7479-5be5-4ee5-a04b-11bb45222833 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:49.132055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-952d7479-5be5-4ee5-a04b-11bb45222833 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:49.132484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-952d7479-5be5-4ee5-a04b-11bb45222833 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:49.260975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-952d7479-5be5-4ee5-a04b-11bb45222833 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:49.268301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-952d7479-5be5-4ee5-a04b-11bb45222833 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.148639 Jun 27 15:00:49.268893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 474/724] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:49 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:49.273936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bc4beec2-41c7-43c7-b69b-33ab85f136b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:49.274532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bc4beec2-41c7-43c7-b69b-33ab85f136b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:49.280325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc4beec2-41c7-43c7-b69b-33ab85f136b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:49.280872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc4beec2-41c7-43c7-b69b-33ab85f136b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:49.281622 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc4beec2-41c7-43c7-b69b-33ab85f136b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:49.282055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc4beec2-41c7-43c7-b69b-33ab85f136b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:49.342438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bc4beec2-41c7-43c7-b69b-33ab85f136b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:49.350490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bc4beec2-41c7-43c7-b69b-33ab85f136b1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.080567 Jun 27 15:00:49.351057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 475/725] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:49 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:49.355626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:49.356151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:49.361723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:49.362188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:49.362931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:49.363353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:49.506819 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:49.514928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:49.516403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:49.517578 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5712fb90-2ea4-4752-9d05-1edd2debe25c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.165619 Jun 27 15:00:49.518128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 476/726] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:00:49 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:00:49.551273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0e755a51-131e-4c7a-9417-4773a0c26163 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:49.551878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0e755a51-131e-4c7a-9417-4773a0c26163 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:49.558117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e755a51-131e-4c7a-9417-4773a0c26163 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:49.558558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e755a51-131e-4c7a-9417-4773a0c26163 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:49.559309 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e755a51-131e-4c7a-9417-4773a0c26163 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:49.559741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e755a51-131e-4c7a-9417-4773a0c26163 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:49.592276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=6 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:49.690536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0e755a51-131e-4c7a-9417-4773a0c26163 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:49.699596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0e755a51-131e-4c7a-9417-4773a0c26163 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.152026 Jun 27 15:00:49.709385 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 477/727] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:49 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:50.285376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-39c39e38-31ea-41a9-bbcb-dc761705c9a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:50.285973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-39c39e38-31ea-41a9-bbcb-dc761705c9a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:50.288263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=36 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:50.293046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39c39e38-31ea-41a9-bbcb-dc761705c9a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:50.293482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39c39e38-31ea-41a9-bbcb-dc761705c9a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:50.294223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39c39e38-31ea-41a9-bbcb-dc761705c9a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:50.294657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39c39e38-31ea-41a9-bbcb-dc761705c9a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:50.435679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-39c39e38-31ea-41a9-bbcb-dc761705c9a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:50.447088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-39c39e38-31ea-41a9-bbcb-dc761705c9a1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.165417 Jun 27 15:00:50.455556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 478/728] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:50 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:50.455556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b6e6c71e-a533-46ec-8c7f-cf88cf4b2de3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:50.455556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b6e6c71e-a533-46ec-8c7f-cf88cf4b2de3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:50.458902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b6e6c71e-a533-46ec-8c7f-cf88cf4b2de3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:50.459349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b6e6c71e-a533-46ec-8c7f-cf88cf4b2de3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:50.460107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b6e6c71e-a533-46ec-8c7f-cf88cf4b2de3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:50.460543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b6e6c71e-a533-46ec-8c7f-cf88cf4b2de3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:50.521716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b6e6c71e-a533-46ec-8c7f-cf88cf4b2de3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:50.529065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b6e6c71e-a533-46ec-8c7f-cf88cf4b2de3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.080444 Jun 27 15:00:50.529625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 479/729] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:50 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:50.544740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:50.545547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:50.553257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:50.553703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:50.554470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:50.554902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:50.686922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:50.695222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:50.696782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:50.697949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4de2c335-e6d8-432a-b9ec-20faaff11fd4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.158667 Jun 27 15:00:50.698508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 480/730] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:00:50 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:00:50.717245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-aeb32473-0887-4e84-b478-04e3361f3bb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:50.717845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-aeb32473-0887-4e84-b478-04e3361f3bb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:50.723684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aeb32473-0887-4e84-b478-04e3361f3bb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:50.724784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aeb32473-0887-4e84-b478-04e3361f3bb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:50.725589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aeb32473-0887-4e84-b478-04e3361f3bb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:50.726021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aeb32473-0887-4e84-b478-04e3361f3bb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:50.864448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-aeb32473-0887-4e84-b478-04e3361f3bb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:50.872322 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-aeb32473-0887-4e84-b478-04e3361f3bb3 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.158716 Jun 27 15:00:50.873118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 481/731] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:50 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:51.473809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2f071973-35b1-474e-b78b-f5c0ff6a6c77 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:51.473809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2f071973-35b1-474e-b78b-f5c0ff6a6c77 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:51.481061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f071973-35b1-474e-b78b-f5c0ff6a6c77 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:51.481786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f071973-35b1-474e-b78b-f5c0ff6a6c77 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:51.484179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f071973-35b1-474e-b78b-f5c0ff6a6c77 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:51.484705 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f071973-35b1-474e-b78b-f5c0ff6a6c77 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:51.621223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2f071973-35b1-474e-b78b-f5c0ff6a6c77 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:51.628512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2f071973-35b1-474e-b78b-f5c0ff6a6c77 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.168239 Jun 27 15:00:51.629093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 482/732] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:51 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:51.776321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8af1ae96-0478-4814-8c6c-27414b963b2f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:51.776321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8af1ae96-0478-4814-8c6c-27414b963b2f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:51.780402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8af1ae96-0478-4814-8c6c-27414b963b2f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:51.780886 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8af1ae96-0478-4814-8c6c-27414b963b2f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:51.781652 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8af1ae96-0478-4814-8c6c-27414b963b2f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:51.782085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8af1ae96-0478-4814-8c6c-27414b963b2f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:51.853157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8af1ae96-0478-4814-8c6c-27414b963b2f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:51.860630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8af1ae96-0478-4814-8c6c-27414b963b2f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.230608 Jun 27 15:00:51.861221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 483/733] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:51 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:51.866498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:51.867092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:51.872769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:51.873219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:51.873975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:51.874410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:52.014101 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:52.022690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:52.024208 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:52.025413 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-359e0234-64a2-402e-93f3-db059f7ad891 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.163282 Jun 27 15:00:52.032540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 484/734] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:00:51 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:00:52.038471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2da4ac9d-fab2-4ce7-9829-b1514e40fe34 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:52.039072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2da4ac9d-fab2-4ce7-9829-b1514e40fe34 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:52.041044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:52.046455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2da4ac9d-fab2-4ce7-9829-b1514e40fe34 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:52.046901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2da4ac9d-fab2-4ce7-9829-b1514e40fe34 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:52.047739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2da4ac9d-fab2-4ce7-9829-b1514e40fe34 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:52.048236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2da4ac9d-fab2-4ce7-9829-b1514e40fe34 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:52.182172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2da4ac9d-fab2-4ce7-9829-b1514e40fe34 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:52.189941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2da4ac9d-fab2-4ce7-9829-b1514e40fe34 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.155993 Jun 27 15:00:52.190500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 485/735] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:52 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:52.646662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a7a5a2f5-44df-4acb-b5a2-71a98e2857f7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:52.648529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a7a5a2f5-44df-4acb-b5a2-71a98e2857f7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:52.659252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7a5a2f5-44df-4acb-b5a2-71a98e2857f7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:52.659702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7a5a2f5-44df-4acb-b5a2-71a98e2857f7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:52.660474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7a5a2f5-44df-4acb-b5a2-71a98e2857f7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:52.660941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7a5a2f5-44df-4acb-b5a2-71a98e2857f7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:52.796427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a7a5a2f5-44df-4acb-b5a2-71a98e2857f7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:52.803850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a7a5a2f5-44df-4acb-b5a2-71a98e2857f7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.161737 Jun 27 15:00:52.804395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 486/736] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:52 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:52.877793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ae92b1ec-18fb-49bf-bd49-f1c8563b9e8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:52.878387 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ae92b1ec-18fb-49bf-bd49-f1c8563b9e8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:52.885397 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ae92b1ec-18fb-49bf-bd49-f1c8563b9e8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:52.885839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ae92b1ec-18fb-49bf-bd49-f1c8563b9e8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:52.886583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ae92b1ec-18fb-49bf-bd49-f1c8563b9e8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:52.887005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ae92b1ec-18fb-49bf-bd49-f1c8563b9e8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:52.905169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:52.949553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ae92b1ec-18fb-49bf-bd49-f1c8563b9e8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:52.956787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ae92b1ec-18fb-49bf-bd49-f1c8563b9e8f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.082722 Jun 27 15:00:52.957355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 487/737] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:52 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:53.043443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:53.043955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:53.050497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:53.050940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:53.051708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:53.052768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:53.181773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:53.190196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:53.191685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:53.193519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b8ca03ee-3079-4421-a0da-7f185fed6350 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.153400 Jun 27 15:00:53.194384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 488/738] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:00:53 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:00:53.209161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-62b59185-a325-4646-a325-2c05a935e87e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:53.209886 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-62b59185-a325-4646-a325-2c05a935e87e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:53.216194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62b59185-a325-4646-a325-2c05a935e87e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:53.216629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62b59185-a325-4646-a325-2c05a935e87e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:53.217485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62b59185-a325-4646-a325-2c05a935e87e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:53.217907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-62b59185-a325-4646-a325-2c05a935e87e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:53.364733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-62b59185-a325-4646-a325-2c05a935e87e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:53.372852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-62b59185-a325-4646-a325-2c05a935e87e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.167595 Jun 27 15:00:53.373415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 489/739] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:53 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:53.821337 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d7d8b128-63aa-4a04-b38c-e19d9cd9bea1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:53.822004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d7d8b128-63aa-4a04-b38c-e19d9cd9bea1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:53.827808 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d7d8b128-63aa-4a04-b38c-e19d9cd9bea1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:53.828249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d7d8b128-63aa-4a04-b38c-e19d9cd9bea1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:53.829031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d7d8b128-63aa-4a04-b38c-e19d9cd9bea1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:53.829459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d7d8b128-63aa-4a04-b38c-e19d9cd9bea1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:53.966719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d7d8b128-63aa-4a04-b38c-e19d9cd9bea1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:53.976738 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d7d8b128-63aa-4a04-b38c-e19d9cd9bea1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.159676 Jun 27 15:00:53.980907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 490/740] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:53 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:53.981859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ffb19dc2-e538-4e29-b7f9-16436aa40f2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:53.982453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ffb19dc2-e538-4e29-b7f9-16436aa40f2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:53.988436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ffb19dc2-e538-4e29-b7f9-16436aa40f2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:53.988910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ffb19dc2-e538-4e29-b7f9-16436aa40f2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:53.989729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ffb19dc2-e538-4e29-b7f9-16436aa40f2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:53.990154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ffb19dc2-e538-4e29-b7f9-16436aa40f2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:54.069121 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ffb19dc2-e538-4e29-b7f9-16436aa40f2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:54.085424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ffb19dc2-e538-4e29-b7f9-16436aa40f2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.099099 Jun 27 15:00:54.085424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 491/741] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:53 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:54.215676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:54.216386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:54.223127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:54.223647 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:54.224512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:54.225296 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:54.371943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:54.379782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:54.381800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:54.382959 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fc3c9f50-4719-449b-aaaa-86ab88c40d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.174279 Jun 27 15:00:54.383524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 492/742] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:00:54 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:00:54.389466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f88db2e4-f974-4a86-b80e-3bbaa362c2dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:54.390156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f88db2e4-f974-4a86-b80e-3bbaa362c2dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:54.396482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f88db2e4-f974-4a86-b80e-3bbaa362c2dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:54.396972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f88db2e4-f974-4a86-b80e-3bbaa362c2dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:54.397735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f88db2e4-f974-4a86-b80e-3bbaa362c2dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:54.398174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f88db2e4-f974-4a86-b80e-3bbaa362c2dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:54.539439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f88db2e4-f974-4a86-b80e-3bbaa362c2dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:54.547298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f88db2e4-f974-4a86-b80e-3bbaa362c2dc tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.161103 Jun 27 15:00:54.547968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 493/743] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:54 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:55.010534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8a1b8012-2081-42e3-b775-6e9b92e8bae6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:55.011490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8a1b8012-2081-42e3-b775-6e9b92e8bae6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:55.020498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8a1b8012-2081-42e3-b775-6e9b92e8bae6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:55.021028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8a1b8012-2081-42e3-b775-6e9b92e8bae6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:55.021796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8a1b8012-2081-42e3-b775-6e9b92e8bae6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:55.022232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8a1b8012-2081-42e3-b775-6e9b92e8bae6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:55.157631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8a1b8012-2081-42e3-b775-6e9b92e8bae6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:55.165566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8a1b8012-2081-42e3-b775-6e9b92e8bae6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.158947 Jun 27 15:00:55.166122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 494/744] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:55 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:55.170424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7510ae26-e1e2-4c80-9cc0-177205f33c80 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:55.171010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7510ae26-e1e2-4c80-9cc0-177205f33c80 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:55.176488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7510ae26-e1e2-4c80-9cc0-177205f33c80 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:55.176961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7510ae26-e1e2-4c80-9cc0-177205f33c80 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:55.177849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7510ae26-e1e2-4c80-9cc0-177205f33c80 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:55.178275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7510ae26-e1e2-4c80-9cc0-177205f33c80 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:55.237820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7510ae26-e1e2-4c80-9cc0-177205f33c80 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:55.246641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7510ae26-e1e2-4c80-9cc0-177205f33c80 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.079462 Jun 27 15:00:55.247479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 495/745] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:55 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:55.508450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:55.508450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:55.517241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:55.517685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:55.518456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:55.518892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:55.646965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:55.655732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:55.657622 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:55.658927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-dedaa9d8-4433-4feb-8b31-fc7d9a5c9381 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.262514 Jun 27 15:00:55.659675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 496/746] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:00:55 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:00:55.665824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9e86aa75-b7bb-441d-b2a7-1c509177e85b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:55.666578 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9e86aa75-b7bb-441d-b2a7-1c509177e85b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:55.679853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e86aa75-b7bb-441d-b2a7-1c509177e85b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:55.680373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e86aa75-b7bb-441d-b2a7-1c509177e85b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:55.682451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e86aa75-b7bb-441d-b2a7-1c509177e85b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:55.682901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e86aa75-b7bb-441d-b2a7-1c509177e85b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:55.822160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9e86aa75-b7bb-441d-b2a7-1c509177e85b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:55.829565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9e86aa75-b7bb-441d-b2a7-1c509177e85b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.168804 Jun 27 15:00:55.830126 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 497/747] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:55 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:56.183580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ab94f2e2-7a1d-4934-adc0-98f09788214f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:56.239479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ab94f2e2-7a1d-4934-adc0-98f09788214f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:56.239479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab94f2e2-7a1d-4934-adc0-98f09788214f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:56.239479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab94f2e2-7a1d-4934-adc0-98f09788214f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:56.239479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab94f2e2-7a1d-4934-adc0-98f09788214f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:56.239926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ab94f2e2-7a1d-4934-adc0-98f09788214f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:56.334049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ab94f2e2-7a1d-4934-adc0-98f09788214f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:56.341360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ab94f2e2-7a1d-4934-adc0-98f09788214f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.162237 Jun 27 15:00:56.341926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 498/748] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:56 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:56.346271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bb0d48b8-6726-4bd5-a091-9b4341512378 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:56.346866 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bb0d48b8-6726-4bd5-a091-9b4341512378 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:56.352484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bb0d48b8-6726-4bd5-a091-9b4341512378 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:56.352954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bb0d48b8-6726-4bd5-a091-9b4341512378 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:56.353710 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bb0d48b8-6726-4bd5-a091-9b4341512378 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:56.354140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bb0d48b8-6726-4bd5-a091-9b4341512378 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:56.425684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bb0d48b8-6726-4bd5-a091-9b4341512378 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:56.434014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bb0d48b8-6726-4bd5-a091-9b4341512378 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.091045 Jun 27 15:00:56.434599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 499/749] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:56 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:56.679139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:56.680005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:56.687339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:56.687816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:56.688613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:56.689069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:56.823737 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:56.831532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:56.833032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:56.834167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0b7aa1a7-511f-4ee9-a460-1a4b71b8f789 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.159555 Jun 27 15:00:56.835363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 500/750] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:00:56 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:00:56.845909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5b4577a8-3ca5-4cf0-9e49-0e8d36c85a7a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:56.846761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5b4577a8-3ca5-4cf0-9e49-0e8d36c85a7a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:56.855734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5b4577a8-3ca5-4cf0-9e49-0e8d36c85a7a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:56.856346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5b4577a8-3ca5-4cf0-9e49-0e8d36c85a7a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:56.857414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5b4577a8-3ca5-4cf0-9e49-0e8d36c85a7a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:56.857960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5b4577a8-3ca5-4cf0-9e49-0e8d36c85a7a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:56.992978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5b4577a8-3ca5-4cf0-9e49-0e8d36c85a7a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:57.000402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5b4577a8-3ca5-4cf0-9e49-0e8d36c85a7a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.158648 Jun 27 15:00:57.000991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 501/751] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:56 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:57.359716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0a2a4d4f-2a28-4d10-82d2-b4cae005db12 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:57.360444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0a2a4d4f-2a28-4d10-82d2-b4cae005db12 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:57.367836 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0a2a4d4f-2a28-4d10-82d2-b4cae005db12 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:57.368277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0a2a4d4f-2a28-4d10-82d2-b4cae005db12 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:57.369091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0a2a4d4f-2a28-4d10-82d2-b4cae005db12 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:57.369514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0a2a4d4f-2a28-4d10-82d2-b4cae005db12 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:57.534064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0a2a4d4f-2a28-4d10-82d2-b4cae005db12 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:57.534064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0a2a4d4f-2a28-4d10-82d2-b4cae005db12 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.161957 Jun 27 15:00:57.534064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 502/752] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:57 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:57.534064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-55cd7a03-3a4e-4a01-8bb2-9a65230972bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:57.534500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-55cd7a03-3a4e-4a01-8bb2-9a65230972bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:57.534500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55cd7a03-3a4e-4a01-8bb2-9a65230972bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:57.534500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55cd7a03-3a4e-4a01-8bb2-9a65230972bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:57.534500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55cd7a03-3a4e-4a01-8bb2-9a65230972bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:57.534837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55cd7a03-3a4e-4a01-8bb2-9a65230972bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:57.597603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-55cd7a03-3a4e-4a01-8bb2-9a65230972bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:57.606427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-55cd7a03-3a4e-4a01-8bb2-9a65230972bc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.087102 Jun 27 15:00:57.607014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 503/753] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:57 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:57.853222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:57.853838 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:57.860578 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:57.861077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:57.861885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:57.862335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:57.866434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:57.990244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:57.998352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:57.999842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:58.001019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a2206bc1-416f-4f1b-afff-041726e8e5c4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.151852 Jun 27 15:00:58.001583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 504/754] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:00:57 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:00:58.016487 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5c1cc023-fdd4-472d-a1e0-5edd29e62b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:58.017099 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5c1cc023-fdd4-472d-a1e0-5edd29e62b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:58.023720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c1cc023-fdd4-472d-a1e0-5edd29e62b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:58.024154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c1cc023-fdd4-472d-a1e0-5edd29e62b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:58.024963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c1cc023-fdd4-472d-a1e0-5edd29e62b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:58.025399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c1cc023-fdd4-472d-a1e0-5edd29e62b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:58.166705 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5c1cc023-fdd4-472d-a1e0-5edd29e62b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:58.175458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5c1cc023-fdd4-472d-a1e0-5edd29e62b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.162561 Jun 27 15:00:58.176020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 505/755] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:58 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:58.534825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-be747eeb-a302-40e0-99d0-ea269cae1da7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:58.535480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-be747eeb-a302-40e0-99d0-ea269cae1da7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:58.545505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-be747eeb-a302-40e0-99d0-ea269cae1da7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:58.545952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-be747eeb-a302-40e0-99d0-ea269cae1da7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:58.546749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-be747eeb-a302-40e0-99d0-ea269cae1da7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:58.547183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-be747eeb-a302-40e0-99d0-ea269cae1da7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:58.682206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-be747eeb-a302-40e0-99d0-ea269cae1da7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:58.690876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-be747eeb-a302-40e0-99d0-ea269cae1da7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.159735 Jun 27 15:00:58.696862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 506/756] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:58 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:58.701642 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ee8240d4-4ee2-4b44-98b5-e2c3de301e62 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:58.701642 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ee8240d4-4ee2-4b44-98b5-e2c3de301e62 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:58.707161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ee8240d4-4ee2-4b44-98b5-e2c3de301e62 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:58.707700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ee8240d4-4ee2-4b44-98b5-e2c3de301e62 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:58.708504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ee8240d4-4ee2-4b44-98b5-e2c3de301e62 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:58.709029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ee8240d4-4ee2-4b44-98b5-e2c3de301e62 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:58.773850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ee8240d4-4ee2-4b44-98b5-e2c3de301e62 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:58.782093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ee8240d4-4ee2-4b44-98b5-e2c3de301e62 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.088671 Jun 27 15:00:58.782093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 507/757] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:58 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:59.019404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:59.019997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:59.026601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:59.027035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:59.027774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:59.028202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:59.271819 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:59.279725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:59.281237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:59.282496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3c82af76-fe3f-4310-8d0c-01e68a779215 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.267101 Jun 27 15:00:59.283045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 508/758] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:00:59 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:00:59.386847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-20bbb5e3-2b44-4182-bfbd-ae9576974d5d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:59.387456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-20bbb5e3-2b44-4182-bfbd-ae9576974d5d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:59.393441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20bbb5e3-2b44-4182-bfbd-ae9576974d5d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:59.393879 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20bbb5e3-2b44-4182-bfbd-ae9576974d5d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:59.394629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20bbb5e3-2b44-4182-bfbd-ae9576974d5d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:59.395062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20bbb5e3-2b44-4182-bfbd-ae9576974d5d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:59.524120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-20bbb5e3-2b44-4182-bfbd-ae9576974d5d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:59.531565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-20bbb5e3-2b44-4182-bfbd-ae9576974d5d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.247586 Jun 27 15:00:59.532131 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 509/759] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:59 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:00:59.707701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2a425746-7a03-4f1b-b8f0-4bb6834f7b80 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:59.708368 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2a425746-7a03-4f1b-b8f0-4bb6834f7b80 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:59.715254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a425746-7a03-4f1b-b8f0-4bb6834f7b80 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:59.715693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a425746-7a03-4f1b-b8f0-4bb6834f7b80 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:59.716436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a425746-7a03-4f1b-b8f0-4bb6834f7b80 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:59.716894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a425746-7a03-4f1b-b8f0-4bb6834f7b80 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:59.846297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2a425746-7a03-4f1b-b8f0-4bb6834f7b80 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:59.854640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2a425746-7a03-4f1b-b8f0-4bb6834f7b80 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.150660 Jun 27 15:00:59.855196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 510/760] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:59 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:00:59.859527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e614a503-3cad-4d2a-b6a0-7ef9079b9ca5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:00:59.860112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e614a503-3cad-4d2a-b6a0-7ef9079b9ca5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:00:59.865614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e614a503-3cad-4d2a-b6a0-7ef9079b9ca5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:59.866092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e614a503-3cad-4d2a-b6a0-7ef9079b9ca5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:59.866883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e614a503-3cad-4d2a-b6a0-7ef9079b9ca5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:00:59.867311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e614a503-3cad-4d2a-b6a0-7ef9079b9ca5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:00:59.926473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e614a503-3cad-4d2a-b6a0-7ef9079b9ca5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:00:59.933728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e614a503-3cad-4d2a-b6a0-7ef9079b9ca5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.077599 Jun 27 15:00:59.934275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 511/761] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:00:59 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:00.300534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:00.301098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:00.307318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:00.307768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:00.308523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:00.308984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:00.434772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:00.442850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:00.444337 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:00.445557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e1872aa6-5e80-4b7b-8390-360f670173a4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.148976 Jun 27 15:01:00.446115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 512/762] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:00 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:00.548563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-deb08ac2-9782-4afb-8ea4-648fce89a6db tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:00.549194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-deb08ac2-9782-4afb-8ea4-648fce89a6db tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:00.555586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-deb08ac2-9782-4afb-8ea4-648fce89a6db tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:00.555969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-deb08ac2-9782-4afb-8ea4-648fce89a6db tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:00.556750 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-deb08ac2-9782-4afb-8ea4-648fce89a6db tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:00.557186 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-deb08ac2-9782-4afb-8ea4-648fce89a6db tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:00.685743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-deb08ac2-9782-4afb-8ea4-648fce89a6db tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:00.693373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-deb08ac2-9782-4afb-8ea4-648fce89a6db tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.148483 Jun 27 15:01:00.693931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 513/763] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:00 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:00.871917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a61a6870-a038-4c78-875f-49712917981b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:00.872508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a61a6870-a038-4c78-875f-49712917981b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:00.878783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a61a6870-a038-4c78-875f-49712917981b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:00.879220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a61a6870-a038-4c78-875f-49712917981b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:00.879965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a61a6870-a038-4c78-875f-49712917981b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:00.880388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a61a6870-a038-4c78-875f-49712917981b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:01.006283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a61a6870-a038-4c78-875f-49712917981b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:01.013660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a61a6870-a038-4c78-875f-49712917981b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.145622 Jun 27 15:01:01.014224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 514/764] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:00 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:01.024357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a68e6904-5664-43ed-8dc0-cf5de2900e04 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:01.024976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a68e6904-5664-43ed-8dc0-cf5de2900e04 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:01.030653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a68e6904-5664-43ed-8dc0-cf5de2900e04 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:01.031142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a68e6904-5664-43ed-8dc0-cf5de2900e04 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:01.031829 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a68e6904-5664-43ed-8dc0-cf5de2900e04 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:01.032255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a68e6904-5664-43ed-8dc0-cf5de2900e04 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:01.093452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a68e6904-5664-43ed-8dc0-cf5de2900e04 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:01.100803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a68e6904-5664-43ed-8dc0-cf5de2900e04 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.085627 Jun 27 15:01:01.102007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 515/765] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:01 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:01.463856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:01.464450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:01.470408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:01.470851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:01.471598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:01.472026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:01.599751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:01.607807 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:01.609324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:01.610468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-44055b5e-6d28-4712-b9f8-28beed9a5982 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.151108 Jun 27 15:01:01.611020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 516/766] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:01 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:01.711743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bef0dfa4-08a7-48c7-aa52-7cf01c6243e6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:01.712348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bef0dfa4-08a7-48c7-aa52-7cf01c6243e6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:01.718358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bef0dfa4-08a7-48c7-aa52-7cf01c6243e6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:01.718778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bef0dfa4-08a7-48c7-aa52-7cf01c6243e6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:01.719607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bef0dfa4-08a7-48c7-aa52-7cf01c6243e6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:01.719965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bef0dfa4-08a7-48c7-aa52-7cf01c6243e6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:01.846129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bef0dfa4-08a7-48c7-aa52-7cf01c6243e6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:01.853672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bef0dfa4-08a7-48c7-aa52-7cf01c6243e6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.146455 Jun 27 15:01:01.854228 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 517/767] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:01 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:02.030276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-33ea484c-e112-4f27-b256-bcc9f4994ae1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:02.030918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-33ea484c-e112-4f27-b256-bcc9f4994ae1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:02.037289 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-33ea484c-e112-4f27-b256-bcc9f4994ae1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:02.037732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-33ea484c-e112-4f27-b256-bcc9f4994ae1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:02.038548 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-33ea484c-e112-4f27-b256-bcc9f4994ae1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:02.038992 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-33ea484c-e112-4f27-b256-bcc9f4994ae1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:02.171977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-33ea484c-e112-4f27-b256-bcc9f4994ae1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:02.179581 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-33ea484c-e112-4f27-b256-bcc9f4994ae1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.152962 Jun 27 15:01:02.180239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 518/768] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:02 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:02.184565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-25d2d055-fae6-436e-9adc-b4f965a9771a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:02.185187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-25d2d055-fae6-436e-9adc-b4f965a9771a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:02.191153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-25d2d055-fae6-436e-9adc-b4f965a9771a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:02.191602 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-25d2d055-fae6-436e-9adc-b4f965a9771a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:02.192376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-25d2d055-fae6-436e-9adc-b4f965a9771a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:02.192837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-25d2d055-fae6-436e-9adc-b4f965a9771a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:02.253454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-25d2d055-fae6-436e-9adc-b4f965a9771a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:02.261448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-25d2d055-fae6-436e-9adc-b4f965a9771a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1312 microversion: 2.1 time: 0.080234 Jun 27 15:01:02.262002 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 519/769] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:02 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:02.630881 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:02.632041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:02.643071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:02.648338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:02.649814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:02.650659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:02.886086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:02.889795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:02.894682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:02.896165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:02.897433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fab6d937-697c-462d-a091-77d5f3bd79f2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.272100 Jun 27 15:01:02.897964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 520/770] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:02 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:02.902750 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-206c3f9d-934b-402d-85bc-1428aeec2d12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:02.903349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-206c3f9d-934b-402d-85bc-1428aeec2d12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:02.909470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-206c3f9d-934b-402d-85bc-1428aeec2d12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:02.912756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-206c3f9d-934b-402d-85bc-1428aeec2d12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:02.912756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-206c3f9d-934b-402d-85bc-1428aeec2d12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:02.912756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-206c3f9d-934b-402d-85bc-1428aeec2d12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:03.140557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-206c3f9d-934b-402d-85bc-1428aeec2d12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:03.149181 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-206c3f9d-934b-402d-85bc-1428aeec2d12 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.249856 Jun 27 15:01:03.149679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 521/771] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:02 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:03.196945 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0f3f070c-c363-47b1-8945-6124a79f8722 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:03.198882 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0f3f070c-c363-47b1-8945-6124a79f8722 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:03.206043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f3f070c-c363-47b1-8945-6124a79f8722 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:03.210172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f3f070c-c363-47b1-8945-6124a79f8722 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:03.210172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f3f070c-c363-47b1-8945-6124a79f8722 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:03.210172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f3f070c-c363-47b1-8945-6124a79f8722 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:03.676367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0f3f070c-c363-47b1-8945-6124a79f8722 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:03.683856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0f3f070c-c363-47b1-8945-6124a79f8722 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.490872 Jun 27 15:01:03.684621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 522/772] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:03 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:03.689241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fb2002b1-30b5-403c-827e-d2f60563cea8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:03.689864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fb2002b1-30b5-403c-827e-d2f60563cea8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:03.696334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb2002b1-30b5-403c-827e-d2f60563cea8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:03.699484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb2002b1-30b5-403c-827e-d2f60563cea8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:03.699484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb2002b1-30b5-403c-827e-d2f60563cea8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:03.699484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb2002b1-30b5-403c-827e-d2f60563cea8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:03.760876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fb2002b1-30b5-403c-827e-d2f60563cea8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:03.768261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fb2002b1-30b5-403c-827e-d2f60563cea8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1300 microversion: 2.1 time: 0.082779 Jun 27 15:01:03.768850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 523/773] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:03 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:03.915895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:03.916977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:03.923475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:03.924141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:03.925194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:03.925627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:04.073725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:04.080156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:04.081613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:04.082751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ad0dda47-fe47-4ea0-a368-f7bb616bc705 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.171269 Jun 27 15:01:04.083301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 524/774] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:03 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:04.166312 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ce0d7f01-a5ed-4907-8af4-176b9c8819f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:04.166910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ce0d7f01-a5ed-4907-8af4-176b9c8819f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:04.172902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ce0d7f01-a5ed-4907-8af4-176b9c8819f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:04.173352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ce0d7f01-a5ed-4907-8af4-176b9c8819f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:04.174141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ce0d7f01-a5ed-4907-8af4-176b9c8819f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:04.174575 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ce0d7f01-a5ed-4907-8af4-176b9c8819f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:04.300320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ce0d7f01-a5ed-4907-8af4-176b9c8819f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:04.308144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ce0d7f01-a5ed-4907-8af4-176b9c8819f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.146088 Jun 27 15:01:04.308720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 525/775] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:04 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:04.700905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3c2232ae-888f-4c0c-8d5b-2e9a5e3a5938 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:04.701510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3c2232ae-888f-4c0c-8d5b-2e9a5e3a5938 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:04.707512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c2232ae-888f-4c0c-8d5b-2e9a5e3a5938 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:04.707956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c2232ae-888f-4c0c-8d5b-2e9a5e3a5938 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:04.708747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c2232ae-888f-4c0c-8d5b-2e9a5e3a5938 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:04.709180 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c2232ae-888f-4c0c-8d5b-2e9a5e3a5938 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:04.839459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3c2232ae-888f-4c0c-8d5b-2e9a5e3a5938 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:04.846839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3c2232ae-888f-4c0c-8d5b-2e9a5e3a5938 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.149806 Jun 27 15:01:04.847395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 526/776] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:04 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:04.852603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-354a5d9a-8bca-4b71-8dd5-3828071c04b5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:04.853465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-354a5d9a-8bca-4b71-8dd5-3828071c04b5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:04.859034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-354a5d9a-8bca-4b71-8dd5-3828071c04b5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:04.859479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-354a5d9a-8bca-4b71-8dd5-3828071c04b5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:04.860231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-354a5d9a-8bca-4b71-8dd5-3828071c04b5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:04.860681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-354a5d9a-8bca-4b71-8dd5-3828071c04b5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:04.985020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-354a5d9a-8bca-4b71-8dd5-3828071c04b5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:04.992428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-354a5d9a-8bca-4b71-8dd5-3828071c04b5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.144103 Jun 27 15:01:04.993014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 527/777] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:04 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:05.101862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:05.102391 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:05.109253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:05.109372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:05.110109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:05.110540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:05.242821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:05.250496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:05.251975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:05.253192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4a29843c-dda1-4707-9313-b24d1dc69a27 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.155924 Jun 27 15:01:05.253740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 528/778] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:05 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:05.325207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-846484d6-24e5-4134-a5c4-5b68d2a3ca24 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:05.325799 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-846484d6-24e5-4134-a5c4-5b68d2a3ca24 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:05.331424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-846484d6-24e5-4134-a5c4-5b68d2a3ca24 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:05.331871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-846484d6-24e5-4134-a5c4-5b68d2a3ca24 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:05.332614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-846484d6-24e5-4134-a5c4-5b68d2a3ca24 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:05.333064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-846484d6-24e5-4134-a5c4-5b68d2a3ca24 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:05.459994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-846484d6-24e5-4134-a5c4-5b68d2a3ca24 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:05.468271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-846484d6-24e5-4134-a5c4-5b68d2a3ca24 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.146530 Jun 27 15:01:05.468862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 529/779] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:05 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:05.864125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-53e77a6a-6606-4510-b2a0-44837620b63a tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:05.864681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-53e77a6a-6606-4510-b2a0-44837620b63a tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:05.871542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-53e77a6a-6606-4510-b2a0-44837620b63a tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:05.871994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-53e77a6a-6606-4510-b2a0-44837620b63a tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:05.872787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-53e77a6a-6606-4510-b2a0-44837620b63a tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:05.873225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-53e77a6a-6606-4510-b2a0-44837620b63a tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:06.004237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-53e77a6a-6606-4510-b2a0-44837620b63a tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:06.011764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-53e77a6a-6606-4510-b2a0-44837620b63a tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.151581 Jun 27 15:01:06.012331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 530/780] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:05 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:06.017019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-65b491c2-f3d3-4b41-a7d5-90cf315955c9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:06.017617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-65b491c2-f3d3-4b41-a7d5-90cf315955c9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:06.023275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65b491c2-f3d3-4b41-a7d5-90cf315955c9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:06.036905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65b491c2-f3d3-4b41-a7d5-90cf315955c9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:06.036905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65b491c2-f3d3-4b41-a7d5-90cf315955c9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:06.036905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65b491c2-f3d3-4b41-a7d5-90cf315955c9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:06.151719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-65b491c2-f3d3-4b41-a7d5-90cf315955c9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:06.159566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-65b491c2-f3d3-4b41-a7d5-90cf315955c9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.146278 Jun 27 15:01:06.160156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 531/781] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:06 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:06.271023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:06.271703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:06.277572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:06.278011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:06.278752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:06.279177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:06.403789 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:06.411787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:06.413988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:06.415299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d6157f63-4392-4d5b-aa9a-cea69853325b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.148054 Jun 27 15:01:06.415851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 532/782] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:06 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:06.485425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7fca5b0e-eed4-4faa-87d8-5434c1c6b95a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:06.486024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7fca5b0e-eed4-4faa-87d8-5434c1c6b95a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:06.492540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7fca5b0e-eed4-4faa-87d8-5434c1c6b95a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:06.493028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7fca5b0e-eed4-4faa-87d8-5434c1c6b95a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:06.493780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7fca5b0e-eed4-4faa-87d8-5434c1c6b95a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:06.494212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7fca5b0e-eed4-4faa-87d8-5434c1c6b95a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:06.624453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7fca5b0e-eed4-4faa-87d8-5434c1c6b95a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:06.631933 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7fca5b0e-eed4-4faa-87d8-5434c1c6b95a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.150105 Jun 27 15:01:06.633547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 533/783] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:06 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:07.027964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f4c8927e-83ea-4f5c-9331-b8905b98c226 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:07.028519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f4c8927e-83ea-4f5c-9331-b8905b98c226 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:07.034535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4c8927e-83ea-4f5c-9331-b8905b98c226 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:07.034980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4c8927e-83ea-4f5c-9331-b8905b98c226 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:07.035748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4c8927e-83ea-4f5c-9331-b8905b98c226 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:07.036181 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4c8927e-83ea-4f5c-9331-b8905b98c226 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:07.162905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f4c8927e-83ea-4f5c-9331-b8905b98c226 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:07.171249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f4c8927e-83ea-4f5c-9331-b8905b98c226 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.147215 Jun 27 15:01:07.171822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 534/784] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:07 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:07.176994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f3d51c5e-bf52-4512-bdf2-27133862ef79 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:07.177590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f3d51c5e-bf52-4512-bdf2-27133862ef79 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:07.179407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:07.184353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3d51c5e-bf52-4512-bdf2-27133862ef79 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:07.192289 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3d51c5e-bf52-4512-bdf2-27133862ef79 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:07.192289 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3d51c5e-bf52-4512-bdf2-27133862ef79 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:07.192289 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f3d51c5e-bf52-4512-bdf2-27133862ef79 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:07.317247 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f3d51c5e-bf52-4512-bdf2-27133862ef79 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:07.325328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f3d51c5e-bf52-4512-bdf2-27133862ef79 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.151862 Jun 27 15:01:07.325902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 535/785] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:07 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:07.433220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:07.433825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:07.440052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:07.440528 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:07.441324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:07.441761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:07.569437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:07.577330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:07.578822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:07.579964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4b459be5-1c0f-49d4-9f31-478a8ceb6e9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.151295 Jun 27 15:01:07.580515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 536/786] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:07 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:07.649492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c07da854-0726-4103-966c-ba6b8ef86bcf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:07.650107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c07da854-0726-4103-966c-ba6b8ef86bcf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:07.656485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c07da854-0726-4103-966c-ba6b8ef86bcf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:07.656955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c07da854-0726-4103-966c-ba6b8ef86bcf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:07.657819 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c07da854-0726-4103-966c-ba6b8ef86bcf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:07.658142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c07da854-0726-4103-966c-ba6b8ef86bcf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:07.676606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:07.785476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c07da854-0726-4103-966c-ba6b8ef86bcf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:07.793437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c07da854-0726-4103-966c-ba6b8ef86bcf tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.147733 Jun 27 15:01:07.793999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 537/787] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:07 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:08.187458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-68c4f17f-fa92-4a72-837b-ef059ab2590e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:08.188065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-68c4f17f-fa92-4a72-837b-ef059ab2590e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:08.195081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68c4f17f-fa92-4a72-837b-ef059ab2590e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:08.195525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68c4f17f-fa92-4a72-837b-ef059ab2590e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:08.196268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68c4f17f-fa92-4a72-837b-ef059ab2590e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:08.196722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68c4f17f-fa92-4a72-837b-ef059ab2590e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:08.325703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-68c4f17f-fa92-4a72-837b-ef059ab2590e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:08.332920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-68c4f17f-fa92-4a72-837b-ef059ab2590e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.149512 Jun 27 15:01:08.333479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 538/788] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:08 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:08.341907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-249bf7df-a5c1-41d1-8dd2-0a3d3c920e2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:08.342510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-249bf7df-a5c1-41d1-8dd2-0a3d3c920e2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:08.348214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-249bf7df-a5c1-41d1-8dd2-0a3d3c920e2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:08.348680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-249bf7df-a5c1-41d1-8dd2-0a3d3c920e2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:08.349422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-249bf7df-a5c1-41d1-8dd2-0a3d3c920e2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:08.349851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-249bf7df-a5c1-41d1-8dd2-0a3d3c920e2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:08.475821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-249bf7df-a5c1-41d1-8dd2-0a3d3c920e2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:08.483157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-249bf7df-a5c1-41d1-8dd2-0a3d3c920e2a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.144784 Jun 27 15:01:08.483722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 539/789] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:08 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:08.597907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:08.598501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:08.604418 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:08.604862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:08.605604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:08.606033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:08.739719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:08.748443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:08.749973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:08.751123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f713d7d8-9a3b-4a12-ae74-66eb36080aa5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.157119 Jun 27 15:01:08.751667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 540/790] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:08 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:08.810158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d9975a09-834e-4719-bea7-3f6cf3dc3dc5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:08.810752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d9975a09-834e-4719-bea7-3f6cf3dc3dc5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:08.816758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9975a09-834e-4719-bea7-3f6cf3dc3dc5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:08.817190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9975a09-834e-4719-bea7-3f6cf3dc3dc5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:08.817930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9975a09-834e-4719-bea7-3f6cf3dc3dc5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:08.818359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9975a09-834e-4719-bea7-3f6cf3dc3dc5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:08.946638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d9975a09-834e-4719-bea7-3f6cf3dc3dc5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:08.954086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d9975a09-834e-4719-bea7-3f6cf3dc3dc5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.147457 Jun 27 15:01:08.954646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 541/791] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:08 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:09.350311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5e7ee9c6-7343-4fca-870f-d705ae73b985 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:09.352333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5e7ee9c6-7343-4fca-870f-d705ae73b985 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:09.359022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5e7ee9c6-7343-4fca-870f-d705ae73b985 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:09.359467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5e7ee9c6-7343-4fca-870f-d705ae73b985 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:09.360218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5e7ee9c6-7343-4fca-870f-d705ae73b985 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:09.360668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5e7ee9c6-7343-4fca-870f-d705ae73b985 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:09.513683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5e7ee9c6-7343-4fca-870f-d705ae73b985 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:09.521028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5e7ee9c6-7343-4fca-870f-d705ae73b985 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.174772 Jun 27 15:01:09.521915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 542/792] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:09 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:09.526819 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-23b1ec57-8fec-4c1b-be70-c897e58f0044 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:09.527411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-23b1ec57-8fec-4c1b-be70-c897e58f0044 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:09.533208 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23b1ec57-8fec-4c1b-be70-c897e58f0044 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:09.533649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23b1ec57-8fec-4c1b-be70-c897e58f0044 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:09.534399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23b1ec57-8fec-4c1b-be70-c897e58f0044 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:09.534825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-23b1ec57-8fec-4c1b-be70-c897e58f0044 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:09.745097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-23b1ec57-8fec-4c1b-be70-c897e58f0044 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:09.752880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-23b1ec57-8fec-4c1b-be70-c897e58f0044 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.230075 Jun 27 15:01:09.753646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 543/793] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:09 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:09.769726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:09.770747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:09.776936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:09.781001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:09.781001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:09.781001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:09.931306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:09.939893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:09.941438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:09.942585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b1f4315e-42bd-4364-8d68-adb56b906ce7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.176809 Jun 27 15:01:09.943160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 544/794] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:09 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:09.971329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f0b5e1bc-7e24-4a0c-928b-46d73c2a2b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:09.972024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f0b5e1bc-7e24-4a0c-928b-46d73c2a2b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:09.978629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0b5e1bc-7e24-4a0c-928b-46d73c2a2b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:09.983824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0b5e1bc-7e24-4a0c-928b-46d73c2a2b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:09.983824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0b5e1bc-7e24-4a0c-928b-46d73c2a2b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:09.983824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0b5e1bc-7e24-4a0c-928b-46d73c2a2b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:10.156450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f0b5e1bc-7e24-4a0c-928b-46d73c2a2b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:10.164501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f0b5e1bc-7e24-4a0c-928b-46d73c2a2b58 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1370 microversion: 2.1 time: 0.196904 Jun 27 15:01:10.165159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 545/795] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:09 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:10.170195 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-3b7c4c1d-7297-4427-813c-a15c7de612fd req-9a73b52a-a1a3-4d67-87f7-38116f143302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc6fa5c-6fa8-4071-a3c0-b52e14b64164", "tag": "f1cf490b-64aa-49c5-a8ae-c54863aae7cc"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:10.179825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-3b7c4c1d-7297-4427-813c-a15c7de612fd req-9a73b52a-a1a3-4d67-87f7-38116f143302 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:10.180265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-3b7c4c1d-7297-4427-813c-a15c7de612fd req-9a73b52a-a1a3-4d67-87f7-38116f143302 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:10.192300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-3b7c4c1d-7297-4427-813c-a15c7de612fd req-9a73b52a-a1a3-4d67-87f7-38116f143302 service nova] Creating event network-changed:f1cf490b-64aa-49c5-a8ae-c54863aae7cc for instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 on hv-cinder-79760 Jun 27 15:01:10.198301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-3b7c4c1d-7297-4427-813c-a15c7de612fd req-9a73b52a-a1a3-4d67-87f7-38116f143302 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032014 Jun 27 15:01:10.199222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 546/796] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:01:10.539122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1e1585f4-2e8e-426e-9dc9-3388ac6bcc07 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:10.539769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1e1585f4-2e8e-426e-9dc9-3388ac6bcc07 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:10.545901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1e1585f4-2e8e-426e-9dc9-3388ac6bcc07 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:10.546344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1e1585f4-2e8e-426e-9dc9-3388ac6bcc07 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:10.547096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1e1585f4-2e8e-426e-9dc9-3388ac6bcc07 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:10.547529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1e1585f4-2e8e-426e-9dc9-3388ac6bcc07 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:10.713938 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1e1585f4-2e8e-426e-9dc9-3388ac6bcc07 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:10.721397 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1e1585f4-2e8e-426e-9dc9-3388ac6bcc07 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.187641 Jun 27 15:01:10.721990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 547/797] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:10 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:10.772114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d28379e7-e9ca-405d-ac61-dcb30b92447e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:10.772885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d28379e7-e9ca-405d-ac61-dcb30b92447e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:10.797739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d28379e7-e9ca-405d-ac61-dcb30b92447e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:10.798184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d28379e7-e9ca-405d-ac61-dcb30b92447e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:10.798947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d28379e7-e9ca-405d-ac61-dcb30b92447e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:10.799370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d28379e7-e9ca-405d-ac61-dcb30b92447e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:11.036718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d28379e7-e9ca-405d-ac61-dcb30b92447e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:11.051017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d28379e7-e9ca-405d-ac61-dcb30b92447e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.283509 Jun 27 15:01:11.051667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 548/798] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:10 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:11.057336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:11.058324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:11.065473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:11.065921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:11.066891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:11.067371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:11.275343 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:11.283789 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:11.285354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:11.286523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2dc73671-365a-48d5-bd66-900a1886043b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.233647 Jun 27 15:01:11.287417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 549/799] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:11 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:11.291995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-45aeb2ca-d383-47d4-ba5a-296e0ff73083 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:11.293287 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-45aeb2ca-d383-47d4-ba5a-296e0ff73083 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:11.299748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45aeb2ca-d383-47d4-ba5a-296e0ff73083 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:11.300103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45aeb2ca-d383-47d4-ba5a-296e0ff73083 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:11.300932 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45aeb2ca-d383-47d4-ba5a-296e0ff73083 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:11.301364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-45aeb2ca-d383-47d4-ba5a-296e0ff73083 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:11.436780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-45aeb2ca-d383-47d4-ba5a-296e0ff73083 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:11.444896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-45aeb2ca-d383-47d4-ba5a-296e0ff73083 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1565 microversion: 2.1 time: 0.155906 Jun 27 15:01:11.445702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 550/800] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:11 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:11.472586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7cf98dcc-4bbb-4824-89c5-1516d42c8753 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:11.473163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7cf98dcc-4bbb-4824-89c5-1516d42c8753 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:11.479304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7cf98dcc-4bbb-4824-89c5-1516d42c8753 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:11.479757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7cf98dcc-4bbb-4824-89c5-1516d42c8753 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:11.480511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7cf98dcc-4bbb-4824-89c5-1516d42c8753 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:11.480988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7cf98dcc-4bbb-4824-89c5-1516d42c8753 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:11.561394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7cf98dcc-4bbb-4824-89c5-1516d42c8753 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092161 Jun 27 15:01:11.562043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 551/801] 10.222.0.44 () {58 vars in 1274 bytes} [Mon Jun 27 15:01:11 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:01:11.740365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-39899ebe-4c15-4a4d-9696-f2de2cafbe96 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:11.741003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-39899ebe-4c15-4a4d-9696-f2de2cafbe96 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:11.747719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39899ebe-4c15-4a4d-9696-f2de2cafbe96 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:11.749486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39899ebe-4c15-4a4d-9696-f2de2cafbe96 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:11.749486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39899ebe-4c15-4a4d-9696-f2de2cafbe96 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:11.749486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39899ebe-4c15-4a4d-9696-f2de2cafbe96 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:11.979870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-39899ebe-4c15-4a4d-9696-f2de2cafbe96 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:11.987344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-39899ebe-4c15-4a4d-9696-f2de2cafbe96 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.250913 Jun 27 15:01:11.987924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 552/802] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:11 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:12.067658 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-71adcd25-25e5-410b-8cdb-10dc8dba7685 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:12.068274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-71adcd25-25e5-410b-8cdb-10dc8dba7685 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:12.075211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-71adcd25-25e5-410b-8cdb-10dc8dba7685 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:12.075687 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-71adcd25-25e5-410b-8cdb-10dc8dba7685 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:12.076448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-71adcd25-25e5-410b-8cdb-10dc8dba7685 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:12.076904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-71adcd25-25e5-410b-8cdb-10dc8dba7685 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:12.211195 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-71adcd25-25e5-410b-8cdb-10dc8dba7685 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:12.218577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-71adcd25-25e5-410b-8cdb-10dc8dba7685 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.154882 Jun 27 15:01:12.219148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 553/803] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:12 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:12.304972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:12.305569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:12.311721 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:12.312167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:12.312944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:12.313375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:12.525109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:12.532972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:12.534472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:12.535632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f89becfe-657b-40e2-b054-c001c9ad6861 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.235259 Jun 27 15:01:12.536193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 554/804] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:12 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:12.981596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-8d515e2f-c310-4ba8-bf02-c9872032f2ae req-8d2e55a8-9773-43f1-9b9c-4d5cb9d76a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c", "tag": "059a8345-bdf4-4361-bf2e-05650504b384"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:12.989980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-8d515e2f-c310-4ba8-bf02-c9872032f2ae req-8d2e55a8-9773-43f1-9b9c-4d5cb9d76a5a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:12.990426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-8d515e2f-c310-4ba8-bf02-c9872032f2ae req-8d2e55a8-9773-43f1-9b9c-4d5cb9d76a5a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:12.994313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:13.001944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-8d515e2f-c310-4ba8-bf02-c9872032f2ae req-8d2e55a8-9773-43f1-9b9c-4d5cb9d76a5a service nova] Creating event network-changed:059a8345-bdf4-4361-bf2e-05650504b384 for instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c on hv-cinder-79760 Jun 27 15:01:13.006702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-8d515e2f-c310-4ba8-bf02-c9872032f2ae req-8d2e55a8-9773-43f1-9b9c-4d5cb9d76a5a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028700 Jun 27 15:01:13.008014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 555/805] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:01:13.013482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2b58e0f5-84e6-4c85-92e4-1a91bdc1715e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:13.014181 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2b58e0f5-84e6-4c85-92e4-1a91bdc1715e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:13.020857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b58e0f5-84e6-4c85-92e4-1a91bdc1715e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:13.021308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b58e0f5-84e6-4c85-92e4-1a91bdc1715e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:13.022077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b58e0f5-84e6-4c85-92e4-1a91bdc1715e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:13.022572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b58e0f5-84e6-4c85-92e4-1a91bdc1715e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:13.156861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2b58e0f5-84e6-4c85-92e4-1a91bdc1715e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:13.164205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2b58e0f5-84e6-4c85-92e4-1a91bdc1715e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.154861 Jun 27 15:01:13.164812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 556/806] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:13 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:13.235433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-767e3d27-5924-4c71-9a03-089bb4b2cffe tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:13.235955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-767e3d27-5924-4c71-9a03-089bb4b2cffe tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:13.249408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-767e3d27-5924-4c71-9a03-089bb4b2cffe tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:13.249853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-767e3d27-5924-4c71-9a03-089bb4b2cffe tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:13.250621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-767e3d27-5924-4c71-9a03-089bb4b2cffe tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:13.251051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-767e3d27-5924-4c71-9a03-089bb4b2cffe tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:13.391731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-767e3d27-5924-4c71-9a03-089bb4b2cffe tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:13.399324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-767e3d27-5924-4c71-9a03-089bb4b2cffe tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.167774 Jun 27 15:01:13.399903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 557/807] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:13 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:13.555297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:13.555838 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:13.561969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:13.562416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:13.563175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:13.563607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:13.690651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:13.698860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:13.700493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:13.701663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4905243b-0307-4c27-bb41-47b232c81f9f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.151065 Jun 27 15:01:13.702236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 558/808] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:13 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:14.181228 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4161fe82-c881-4278-99cf-be3e2844bf13 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:14.181905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4161fe82-c881-4278-99cf-be3e2844bf13 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:14.188863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4161fe82-c881-4278-99cf-be3e2844bf13 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:14.189304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4161fe82-c881-4278-99cf-be3e2844bf13 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:14.190051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4161fe82-c881-4278-99cf-be3e2844bf13 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:14.190477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4161fe82-c881-4278-99cf-be3e2844bf13 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:14.323687 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4161fe82-c881-4278-99cf-be3e2844bf13 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:14.331999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4161fe82-c881-4278-99cf-be3e2844bf13 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.154884 Jun 27 15:01:14.332706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 559/809] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:14 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:14.416104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-96bf86e3-f52d-4115-8604-1f38e02923de tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:14.416736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-96bf86e3-f52d-4115-8604-1f38e02923de tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:14.422639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96bf86e3-f52d-4115-8604-1f38e02923de tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:14.423086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96bf86e3-f52d-4115-8604-1f38e02923de tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:14.423837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96bf86e3-f52d-4115-8604-1f38e02923de tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:14.424267 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96bf86e3-f52d-4115-8604-1f38e02923de tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:14.550277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-96bf86e3-f52d-4115-8604-1f38e02923de tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:14.557728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-96bf86e3-f52d-4115-8604-1f38e02923de tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.145728 Jun 27 15:01:14.558285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 560/810] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:14 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:14.719738 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:14.720253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:14.726484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:14.727275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:14.728476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:14.728954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:14.854718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:14.862801 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:14.864282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:14.865489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-03a12951-2491-4541-beb0-619e5e56827d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.149652 Jun 27 15:01:14.866040 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 561/811] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:14 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:15.349654 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d594bac5-455c-4180-bcda-ff81355a5177 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:15.350269 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d594bac5-455c-4180-bcda-ff81355a5177 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:15.357047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d594bac5-455c-4180-bcda-ff81355a5177 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:15.357488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d594bac5-455c-4180-bcda-ff81355a5177 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:15.358234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d594bac5-455c-4180-bcda-ff81355a5177 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:15.358664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d594bac5-455c-4180-bcda-ff81355a5177 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:15.490114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d594bac5-455c-4180-bcda-ff81355a5177 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:15.498662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d594bac5-455c-4180-bcda-ff81355a5177 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.151876 Jun 27 15:01:15.498662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 562/812] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:15 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:15.574746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a4373d04-f457-4880-b0b2-ab3dcd233e61 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:15.575493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a4373d04-f457-4880-b0b2-ab3dcd233e61 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:15.581219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4373d04-f457-4880-b0b2-ab3dcd233e61 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:15.581675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4373d04-f457-4880-b0b2-ab3dcd233e61 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:15.582394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4373d04-f457-4880-b0b2-ab3dcd233e61 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:15.582835 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a4373d04-f457-4880-b0b2-ab3dcd233e61 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:15.708805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a4373d04-f457-4880-b0b2-ab3dcd233e61 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:15.716831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a4373d04-f457-4880-b0b2-ab3dcd233e61 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.145732 Jun 27 15:01:15.717385 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 563/813] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:15 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:15.883503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:15.884096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:15.889918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:15.890355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:15.891092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:15.891511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:16.020250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:16.028947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:16.030443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:16.031602 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0668bb46-ae1c-4fb6-863c-6a92f598026c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.152349 Jun 27 15:01:16.032162 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 564/814] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:15 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:16.514527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-20c468ce-9a95-494b-b6d6-2a8e50f1bf73 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:16.515153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-20c468ce-9a95-494b-b6d6-2a8e50f1bf73 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:16.521620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20c468ce-9a95-494b-b6d6-2a8e50f1bf73 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:16.522070 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20c468ce-9a95-494b-b6d6-2a8e50f1bf73 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:16.522978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20c468ce-9a95-494b-b6d6-2a8e50f1bf73 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:16.523412 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20c468ce-9a95-494b-b6d6-2a8e50f1bf73 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:16.648258 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-20c468ce-9a95-494b-b6d6-2a8e50f1bf73 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:16.655801 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-20c468ce-9a95-494b-b6d6-2a8e50f1bf73 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.145079 Jun 27 15:01:16.660140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 565/815] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:16 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:16.733318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a0655673-06bd-4218-b5d2-729f7db152b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:16.733925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a0655673-06bd-4218-b5d2-729f7db152b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:16.740079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0655673-06bd-4218-b5d2-729f7db152b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:16.740531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0655673-06bd-4218-b5d2-729f7db152b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:16.742025 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0655673-06bd-4218-b5d2-729f7db152b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:16.742461 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0655673-06bd-4218-b5d2-729f7db152b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:16.868358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a0655673-06bd-4218-b5d2-729f7db152b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:16.875724 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a0655673-06bd-4218-b5d2-729f7db152b2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.146244 Jun 27 15:01:16.876294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 566/816] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:16 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:17.049617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:17.050234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:17.056235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:17.056809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:17.057634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:17.058064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:17.189033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:17.197400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:17.198818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:17.199985 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-afcfb180-9a9e-4609-acda-1fb9fd690872 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.154292 Jun 27 15:01:17.200732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 567/817] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:17 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:17.672953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a0b1c807-0f48-4e46-99f1-09b79bf2b875 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:17.676161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a0b1c807-0f48-4e46-99f1-09b79bf2b875 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:17.680299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0b1c807-0f48-4e46-99f1-09b79bf2b875 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:17.680782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0b1c807-0f48-4e46-99f1-09b79bf2b875 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:17.681620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0b1c807-0f48-4e46-99f1-09b79bf2b875 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:17.682050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0b1c807-0f48-4e46-99f1-09b79bf2b875 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:17.808780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a0b1c807-0f48-4e46-99f1-09b79bf2b875 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:17.816259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a0b1c807-0f48-4e46-99f1-09b79bf2b875 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.147280 Jun 27 15:01:17.816843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 568/818] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:17 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:17.890768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-303331c4-3ee0-4fdb-9528-69b4e4adcb38 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:17.891389 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-303331c4-3ee0-4fdb-9528-69b4e4adcb38 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:17.897053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-303331c4-3ee0-4fdb-9528-69b4e4adcb38 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:17.898105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-303331c4-3ee0-4fdb-9528-69b4e4adcb38 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:17.898969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-303331c4-3ee0-4fdb-9528-69b4e4adcb38 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:17.899394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-303331c4-3ee0-4fdb-9528-69b4e4adcb38 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:18.028827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-303331c4-3ee0-4fdb-9528-69b4e4adcb38 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:18.036083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-303331c4-3ee0-4fdb-9528-69b4e4adcb38 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.148884 Jun 27 15:01:18.036659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 569/819] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:17 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:18.218116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:18.218697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:18.224851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:18.225299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:18.226073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:18.226504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:18.350765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:18.358821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:18.360322 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:18.361515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3a598dd3-881c-40e2-8000-f04664e5f9a7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.147294 Jun 27 15:01:18.362076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 570/820] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:18 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:18.833144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cf812632-243d-4381-8207-6f7595dab937 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:18.833737 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cf812632-243d-4381-8207-6f7595dab937 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:18.840745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf812632-243d-4381-8207-6f7595dab937 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:18.850122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf812632-243d-4381-8207-6f7595dab937 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:18.850122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf812632-243d-4381-8207-6f7595dab937 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:18.850122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf812632-243d-4381-8207-6f7595dab937 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:18.971940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cf812632-243d-4381-8207-6f7595dab937 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:18.979929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cf812632-243d-4381-8207-6f7595dab937 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.150882 Jun 27 15:01:18.980495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 571/821] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:18 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:19.052332 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a66d5269-29ad-4a02-ac3d-675927cb9c4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:19.052961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a66d5269-29ad-4a02-ac3d-675927cb9c4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:19.059478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a66d5269-29ad-4a02-ac3d-675927cb9c4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:19.059922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a66d5269-29ad-4a02-ac3d-675927cb9c4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:19.060730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a66d5269-29ad-4a02-ac3d-675927cb9c4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:19.061416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a66d5269-29ad-4a02-ac3d-675927cb9c4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:19.079194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:19.191244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a66d5269-29ad-4a02-ac3d-675927cb9c4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:19.199041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a66d5269-29ad-4a02-ac3d-675927cb9c4b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.150407 Jun 27 15:01:19.199612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 572/822] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:19 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:19.380306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:19.380842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:19.387108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:19.387543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:19.388284 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:19.388732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:19.518448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:19.526879 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:19.528350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:19.529515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0815f7b5-730c-4c29-8a32-3e4a6699c7be tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.153150 Jun 27 15:01:19.530061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 573/823] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:19 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:19.996677 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c23b8fda-e590-4893-9bde-4873d3737a7d tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:19.997350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c23b8fda-e590-4893-9bde-4873d3737a7d tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:20.003868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c23b8fda-e590-4893-9bde-4873d3737a7d tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:20.004317 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c23b8fda-e590-4893-9bde-4873d3737a7d tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:20.005102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c23b8fda-e590-4893-9bde-4873d3737a7d tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:20.005535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c23b8fda-e590-4893-9bde-4873d3737a7d tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:20.140345 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c23b8fda-e590-4893-9bde-4873d3737a7d tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:20.147800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c23b8fda-e590-4893-9bde-4873d3737a7d tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.155009 Jun 27 15:01:20.148552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 574/824] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:19 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:20.215115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-55d1968d-c12c-4eec-b0c3-482738b7c218 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:20.215715 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-55d1968d-c12c-4eec-b0c3-482738b7c218 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:20.221714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55d1968d-c12c-4eec-b0c3-482738b7c218 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:20.222153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55d1968d-c12c-4eec-b0c3-482738b7c218 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:20.222896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55d1968d-c12c-4eec-b0c3-482738b7c218 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:20.223319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55d1968d-c12c-4eec-b0c3-482738b7c218 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:20.354340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-55d1968d-c12c-4eec-b0c3-482738b7c218 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:20.361616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-55d1968d-c12c-4eec-b0c3-482738b7c218 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.150212 Jun 27 15:01:20.362175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 575/825] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:20 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:20.547183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:20.547782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:20.554490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:20.554877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:20.555626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:20.556057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:20.686813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:20.694652 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:20.696152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:20.697335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8897439e-9b0e-477b-b76b-086bc5ffe951 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.154048 Jun 27 15:01:20.697889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 576/826] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:20 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:21.164541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-70098175-d545-4b88-ac48-13497b25f834 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:21.165204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-70098175-d545-4b88-ac48-13497b25f834 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:21.171627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-70098175-d545-4b88-ac48-13497b25f834 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:21.172066 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-70098175-d545-4b88-ac48-13497b25f834 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:21.172846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-70098175-d545-4b88-ac48-13497b25f834 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:21.173269 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-70098175-d545-4b88-ac48-13497b25f834 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:21.301367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-70098175-d545-4b88-ac48-13497b25f834 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:21.308693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-70098175-d545-4b88-ac48-13497b25f834 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.147951 Jun 27 15:01:21.309252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 577/827] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:21 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:21.378064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a0fa70fb-6e68-43f7-8365-1934f17b33ec tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:21.378573 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a0fa70fb-6e68-43f7-8365-1934f17b33ec tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:21.385058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0fa70fb-6e68-43f7-8365-1934f17b33ec tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:21.385494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0fa70fb-6e68-43f7-8365-1934f17b33ec tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:21.386244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0fa70fb-6e68-43f7-8365-1934f17b33ec tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:21.386667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0fa70fb-6e68-43f7-8365-1934f17b33ec tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:21.512319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a0fa70fb-6e68-43f7-8365-1934f17b33ec tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:21.519631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a0fa70fb-6e68-43f7-8365-1934f17b33ec tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.145213 Jun 27 15:01:21.520191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 578/828] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:21 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:21.716133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:21.716777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:21.722565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:21.723005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:21.724012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:21.724437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:21.854346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:21.862302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:21.863798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:21.866653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0ae435f9-3dc7-4b4e-bfb6-a9e4920defd5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.153417 Jun 27 15:01:21.866653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 579/829] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:21 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:21.986520 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a78a7ae1-542e-4af1-894b-66f36767ac73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:21.987008 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a78a7ae1-542e-4af1-894b-66f36767ac73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:21.993529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a78a7ae1-542e-4af1-894b-66f36767ac73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:21.993969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a78a7ae1-542e-4af1-894b-66f36767ac73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:21.994731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a78a7ae1-542e-4af1-894b-66f36767ac73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:21.995156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a78a7ae1-542e-4af1-894b-66f36767ac73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:22.116803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-a78a7ae1-542e-4af1-894b-66f36767ac73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lazy-loading 'services' on Instance uuid 3162d971-6d40-49fc-adc7-0f702415b9e6 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:01:22.374580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a78a7ae1-542e-4af1-894b-66f36767ac73 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6/os-volume_attachments/f35bbce1-afe0-4755-aa0f-34f754c62acc" status: 202 len: 0 microversion: 2.1 time: 0.391739 Jun 27 15:01:22.375279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 580/830] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:01:21 2022] DELETE /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6/os-volume_attachments/f35bbce1-afe0-4755-aa0f-34f754c62acc => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:01:22.381319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-dfe7bd5d-99fd-44fe-8c69-cd1cb383a3b0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:22.382010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-dfe7bd5d-99fd-44fe-8c69-cd1cb383a3b0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:22.388177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dfe7bd5d-99fd-44fe-8c69-cd1cb383a3b0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:22.388626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dfe7bd5d-99fd-44fe-8c69-cd1cb383a3b0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:22.389399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dfe7bd5d-99fd-44fe-8c69-cd1cb383a3b0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:22.389829 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dfe7bd5d-99fd-44fe-8c69-cd1cb383a3b0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:22.520724 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-dfe7bd5d-99fd-44fe-8c69-cd1cb383a3b0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:22.528906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-dfe7bd5d-99fd-44fe-8c69-cd1cb383a3b0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.151859 Jun 27 15:01:22.529456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 581/831] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:22 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:22.536208 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c1409237-9a0e-44bc-98a5-e3a8567273d0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:22.536941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c1409237-9a0e-44bc-98a5-e3a8567273d0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:22.542838 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1409237-9a0e-44bc-98a5-e3a8567273d0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:22.543279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1409237-9a0e-44bc-98a5-e3a8567273d0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:22.544029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1409237-9a0e-44bc-98a5-e3a8567273d0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:22.544456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1409237-9a0e-44bc-98a5-e3a8567273d0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:22.673889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c1409237-9a0e-44bc-98a5-e3a8567273d0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:22.681318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c1409237-9a0e-44bc-98a5-e3a8567273d0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.148697 Jun 27 15:01:22.681867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 582/832] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:22 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:22.884294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:22.884850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:22.891204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:22.891645 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:22.892391 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:22.892853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:23.020782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:23.029268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:23.030752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:23.031926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-abbf58a9-d49d-4ccc-abf2-9b9ad9415e62 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.152551 Jun 27 15:01:23.032479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 583/833] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:22 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:23.416445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-76be9b4c-728d-43ae-a309-1dca0ba6decc req-d561eee4-a964-4408-b8e2-a47f18a8a681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc6fa5c-6fa8-4071-a3c0-b52e14b64164", "name": "network-vif-plugged", "status": "completed", "tag": "f1cf490b-64aa-49c5-a8ae-c54863aae7cc"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:23.425162 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-76be9b4c-728d-43ae-a309-1dca0ba6decc req-d561eee4-a964-4408-b8e2-a47f18a8a681 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:23.425667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-76be9b4c-728d-43ae-a309-1dca0ba6decc req-d561eee4-a964-4408-b8e2-a47f18a8a681 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:23.438295 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-76be9b4c-728d-43ae-a309-1dca0ba6decc req-d561eee4-a964-4408-b8e2-a47f18a8a681 service nova] Creating event network-vif-plugged:f1cf490b-64aa-49c5-a8ae-c54863aae7cc for instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 on hv-cinder-79760 Jun 27 15:01:23.442379 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-76be9b4c-728d-43ae-a309-1dca0ba6decc req-d561eee4-a964-4408-b8e2-a47f18a8a681 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030335 Jun 27 15:01:23.442969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 584/834] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:01:23.546211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-49bfc88f-e83f-4e6f-898a-5b53a7d1ae25 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:23.546923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-49bfc88f-e83f-4e6f-898a-5b53a7d1ae25 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:23.548908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:23.554696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-49bfc88f-e83f-4e6f-898a-5b53a7d1ae25 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:23.554968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-49bfc88f-e83f-4e6f-898a-5b53a7d1ae25 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:23.555725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-49bfc88f-e83f-4e6f-898a-5b53a7d1ae25 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:23.556159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-49bfc88f-e83f-4e6f-898a-5b53a7d1ae25 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:23.685187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-49bfc88f-e83f-4e6f-898a-5b53a7d1ae25 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:23.692748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-49bfc88f-e83f-4e6f-898a-5b53a7d1ae25 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.150763 Jun 27 15:01:23.693307 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 585/835] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:23 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:23.697805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-94d88e91-2b97-4179-bf12-3bdf4d0a6303 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:23.698399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-94d88e91-2b97-4179-bf12-3bdf4d0a6303 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:23.703918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94d88e91-2b97-4179-bf12-3bdf4d0a6303 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:23.704361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94d88e91-2b97-4179-bf12-3bdf4d0a6303 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:23.705140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94d88e91-2b97-4179-bf12-3bdf4d0a6303 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:23.705573 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94d88e91-2b97-4179-bf12-3bdf4d0a6303 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:23.835684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-94d88e91-2b97-4179-bf12-3bdf4d0a6303 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:23.843004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-94d88e91-2b97-4179-bf12-3bdf4d0a6303 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.148769 Jun 27 15:01:23.843571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 586/836] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:23 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:24.053822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:24.053822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:24.057261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:24.057701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:24.058481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:24.058908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:24.187831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:24.196332 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:24.197875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:24.199022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3ec19c52-affc-4340-bf21-57dc9c9e9ec6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.152981 Jun 27 15:01:24.199572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 587/837] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:24 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:24.709286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-052253d8-285a-4514-9b50-4656c9fb2aee tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:24.709946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-052253d8-285a-4514-9b50-4656c9fb2aee tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:24.716117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-052253d8-285a-4514-9b50-4656c9fb2aee tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:24.716827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-052253d8-285a-4514-9b50-4656c9fb2aee tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:24.717790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-052253d8-285a-4514-9b50-4656c9fb2aee tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:24.718232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-052253d8-285a-4514-9b50-4656c9fb2aee tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:24.994927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-052253d8-285a-4514-9b50-4656c9fb2aee tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:25.002396 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-052253d8-285a-4514-9b50-4656c9fb2aee tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.296930 Jun 27 15:01:25.002964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 588/838] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:24 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:25.007406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6b95df4d-a954-4169-a5fb-5e7c6ad8a7d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:25.008009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6b95df4d-a954-4169-a5fb-5e7c6ad8a7d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:25.013646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6b95df4d-a954-4169-a5fb-5e7c6ad8a7d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:25.014095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6b95df4d-a954-4169-a5fb-5e7c6ad8a7d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:25.014859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6b95df4d-a954-4169-a5fb-5e7c6ad8a7d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:25.015289 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6b95df4d-a954-4169-a5fb-5e7c6ad8a7d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:25.019350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:25.146574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6b95df4d-a954-4169-a5fb-5e7c6ad8a7d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:25.154503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6b95df4d-a954-4169-a5fb-5e7c6ad8a7d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.150601 Jun 27 15:01:25.155052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 589/839] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:25 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:25.217113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:25.217638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:25.223555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:25.223993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:25.224762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:25.225189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:25.358428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:25.368073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:25.369704 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:25.371009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-85d8b10c-038e-4a77-94b1-a3594246a2bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.158008 Jun 27 15:01:25.371851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 590/840] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:25 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:25.597462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0c18b2b7-787d-45f1-b986-fdbd92d0457f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:25.597954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0c18b2b7-787d-45f1-b986-fdbd92d0457f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:25.603900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c18b2b7-787d-45f1-b986-fdbd92d0457f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:25.604354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c18b2b7-787d-45f1-b986-fdbd92d0457f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:25.605128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c18b2b7-787d-45f1-b986-fdbd92d0457f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:25.605561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c18b2b7-787d-45f1-b986-fdbd92d0457f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:25.629582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0c18b2b7-787d-45f1-b986-fdbd92d0457f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:01:25.900988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0c18b2b7-787d-45f1-b986-fdbd92d0457f tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 204 len: 0 microversion: 2.1 time: 0.306992 Jun 27 15:01:25.901643 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 591/841] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:01:25 2022] DELETE /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:01:25.909910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3cf3620a-541c-4a21-b075-f4039726eb39 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:25.914125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3cf3620a-541c-4a21-b075-f4039726eb39 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:25.916838 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cf3620a-541c-4a21-b075-f4039726eb39 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:25.917290 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cf3620a-541c-4a21-b075-f4039726eb39 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:25.918051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cf3620a-541c-4a21-b075-f4039726eb39 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:25.918482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cf3620a-541c-4a21-b075-f4039726eb39 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:26.046684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3cf3620a-541c-4a21-b075-f4039726eb39 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:26.055014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3cf3620a-541c-4a21-b075-f4039726eb39 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1514 microversion: 2.1 time: 0.149026 Jun 27 15:01:26.055573 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 592/842] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:25 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:26.068607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-436c8087-e396-4bca-83ea-e58c39063210 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:26.070045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-436c8087-e396-4bca-83ea-e58c39063210 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:26.076425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-436c8087-e396-4bca-83ea-e58c39063210 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:26.076910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-436c8087-e396-4bca-83ea-e58c39063210 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:26.077670 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-436c8087-e396-4bca-83ea-e58c39063210 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:26.078102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-436c8087-e396-4bca-83ea-e58c39063210 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:26.214440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-436c8087-e396-4bca-83ea-e58c39063210 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:26.221774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-436c8087-e396-4bca-83ea-e58c39063210 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.156820 Jun 27 15:01:26.222332 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 593/843] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:26 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:26.226641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a58cf362-c8b1-4084-9b90-5b9b03e224f7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:26.227227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a58cf362-c8b1-4084-9b90-5b9b03e224f7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:26.232767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a58cf362-c8b1-4084-9b90-5b9b03e224f7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:26.233219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a58cf362-c8b1-4084-9b90-5b9b03e224f7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:26.233966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a58cf362-c8b1-4084-9b90-5b9b03e224f7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:26.234395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a58cf362-c8b1-4084-9b90-5b9b03e224f7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:26.366741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a58cf362-c8b1-4084-9b90-5b9b03e224f7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:26.374181 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a58cf362-c8b1-4084-9b90-5b9b03e224f7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.150923 Jun 27 15:01:26.374739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 594/844] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:26 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:26.388493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:26.389112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:26.394643 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:26.395086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:26.395833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:26.396266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:26.521257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:26.530184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:26.531660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:26.532829 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1d5593a1-ea46-42f6-8b77-2fdd65ff80f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.147839 Jun 27 15:01:26.533392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 595/845] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:26 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:27.072591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-af88a519-4426-4f73-b896-180abfd7d693 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:27.073282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-af88a519-4426-4f73-b896-180abfd7d693 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:27.079702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af88a519-4426-4f73-b896-180abfd7d693 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:27.080146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af88a519-4426-4f73-b896-180abfd7d693 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:27.080917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af88a519-4426-4f73-b896-180abfd7d693 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:27.081345 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af88a519-4426-4f73-b896-180abfd7d693 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:27.217216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-af88a519-4426-4f73-b896-180abfd7d693 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:27.224591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-af88a519-4426-4f73-b896-180abfd7d693 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1514 microversion: 2.1 time: 0.155929 Jun 27 15:01:27.225694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 596/846] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:27 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:27.238044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6cc0264f-da40-4d18-9dcf-1b7c36a2ce78 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:27.238677 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6cc0264f-da40-4d18-9dcf-1b7c36a2ce78 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:27.245368 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6cc0264f-da40-4d18-9dcf-1b7c36a2ce78 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:27.245812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6cc0264f-da40-4d18-9dcf-1b7c36a2ce78 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:27.246572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6cc0264f-da40-4d18-9dcf-1b7c36a2ce78 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:27.247004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6cc0264f-da40-4d18-9dcf-1b7c36a2ce78 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:27.375604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6cc0264f-da40-4d18-9dcf-1b7c36a2ce78 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:27.383036 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6cc0264f-da40-4d18-9dcf-1b7c36a2ce78 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.148693 Jun 27 15:01:27.383590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 597/847] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:27 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:27.390840 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bd3f785a-2d74-4af6-9af7-3df1ffad72ef tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:27.391601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bd3f785a-2d74-4af6-9af7-3df1ffad72ef tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:27.397972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bd3f785a-2d74-4af6-9af7-3df1ffad72ef tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:27.401976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bd3f785a-2d74-4af6-9af7-3df1ffad72ef tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:27.401976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bd3f785a-2d74-4af6-9af7-3df1ffad72ef tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:27.401976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bd3f785a-2d74-4af6-9af7-3df1ffad72ef tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:27.526615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bd3f785a-2d74-4af6-9af7-3df1ffad72ef tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:27.533890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bd3f785a-2d74-4af6-9af7-3df1ffad72ef tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.146817 Jun 27 15:01:27.534440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 598/848] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:27 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:27.550585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:27.551178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:27.556979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:27.557423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:27.558170 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:27.558598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:27.687402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:27.695992 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:27.697514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:27.698668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-577ebc40-cb45-4e2a-8004-299ab5fcaf8b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1744 microversion: 2.20 time: 0.151658 Jun 27 15:01:27.699259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 599/849] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:27 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:28.099329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-2e18d645-a350-480a-b96a-7dce63d60894 req-f74732ac-4dac-4fa1-9be9-0595a26bc998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f21014-5688-42b2-990a-51b99ff11e91", "name": "network-vif-plugged", "status": "completed", "tag": "53878d21-1d99-4fed-a685-f691228ebaa2"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:28.108612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-2e18d645-a350-480a-b96a-7dce63d60894 req-f74732ac-4dac-4fa1-9be9-0595a26bc998 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:28.109102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-2e18d645-a350-480a-b96a-7dce63d60894 req-f74732ac-4dac-4fa1-9be9-0595a26bc998 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:28.121480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-2e18d645-a350-480a-b96a-7dce63d60894 req-f74732ac-4dac-4fa1-9be9-0595a26bc998 service nova] Creating event network-vif-plugged:53878d21-1d99-4fed-a685-f691228ebaa2 for instance c2f21014-5688-42b2-990a-51b99ff11e91 on hv-cinder-79760 Jun 27 15:01:28.126856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-2e18d645-a350-480a-b96a-7dce63d60894 req-f74732ac-4dac-4fa1-9be9-0595a26bc998 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031171 Jun 27 15:01:28.127435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 600/850] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:01:28.243189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-05007d0b-8aaf-4460-9cdb-0788ee311f24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:28.243814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-05007d0b-8aaf-4460-9cdb-0788ee311f24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:28.250454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05007d0b-8aaf-4460-9cdb-0788ee311f24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:28.250929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05007d0b-8aaf-4460-9cdb-0788ee311f24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:28.251671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05007d0b-8aaf-4460-9cdb-0788ee311f24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:28.252123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05007d0b-8aaf-4460-9cdb-0788ee311f24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:28.384163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-05007d0b-8aaf-4460-9cdb-0788ee311f24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:28.391632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-05007d0b-8aaf-4460-9cdb-0788ee311f24 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1514 microversion: 2.1 time: 0.153261 Jun 27 15:01:28.392186 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 601/851] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:28 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:28.399566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ade20ad3-cc16-4ab8-a70f-507fa326127f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:28.400215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ade20ad3-cc16-4ab8-a70f-507fa326127f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:28.406205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ade20ad3-cc16-4ab8-a70f-507fa326127f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:28.406648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ade20ad3-cc16-4ab8-a70f-507fa326127f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:28.407411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ade20ad3-cc16-4ab8-a70f-507fa326127f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:28.407843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ade20ad3-cc16-4ab8-a70f-507fa326127f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:28.541817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ade20ad3-cc16-4ab8-a70f-507fa326127f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:28.549469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ade20ad3-cc16-4ab8-a70f-507fa326127f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.153942 Jun 27 15:01:28.550034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 602/852] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:28 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:28.555075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-070e51b0-1590-45bf-96fc-1cde129d3912 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:28.555888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-070e51b0-1590-45bf-96fc-1cde129d3912 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:28.562115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-070e51b0-1590-45bf-96fc-1cde129d3912 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:28.562570 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-070e51b0-1590-45bf-96fc-1cde129d3912 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:28.563329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-070e51b0-1590-45bf-96fc-1cde129d3912 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:28.563764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-070e51b0-1590-45bf-96fc-1cde129d3912 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:28.690657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-070e51b0-1590-45bf-96fc-1cde129d3912 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:28.698055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-070e51b0-1590-45bf-96fc-1cde129d3912 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1368 microversion: 2.1 time: 0.147091 Jun 27 15:01:28.698607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 603/853] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:28 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:28.716592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:28.717223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:28.722912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:28.723356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:28.724100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:28.724533 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:28.855483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:28.858698 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:28.863494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:28.865008 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:28.866167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f857b9d3-e88a-4c01-a84b-14e3761e2b42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1744 microversion: 2.20 time: 0.153190 Jun 27 15:01:28.866720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 604/854] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:28 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:29.408927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d36da07e-a95d-4e98-b833-c9e2f9aae81c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:29.409583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d36da07e-a95d-4e98-b833-c9e2f9aae81c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:29.417372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d36da07e-a95d-4e98-b833-c9e2f9aae81c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.417818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d36da07e-a95d-4e98-b833-c9e2f9aae81c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:29.418568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d36da07e-a95d-4e98-b833-c9e2f9aae81c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.418996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d36da07e-a95d-4e98-b833-c9e2f9aae81c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:29.546873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d36da07e-a95d-4e98-b833-c9e2f9aae81c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:29.554908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d36da07e-a95d-4e98-b833-c9e2f9aae81c tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1514 microversion: 2.1 time: 0.149883 Jun 27 15:01:29.555468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 605/855] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:29 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:29.566815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f800535d-b736-4d85-91fe-c29ed3694356 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:29.567404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f800535d-b736-4d85-91fe-c29ed3694356 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:29.572975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f800535d-b736-4d85-91fe-c29ed3694356 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.573419 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f800535d-b736-4d85-91fe-c29ed3694356 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:29.574167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f800535d-b736-4d85-91fe-c29ed3694356 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.574615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f800535d-b736-4d85-91fe-c29ed3694356 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:29.701823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f800535d-b736-4d85-91fe-c29ed3694356 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:29.709368 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f800535d-b736-4d85-91fe-c29ed3694356 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.145933 Jun 27 15:01:29.710394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 606/856] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:29 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:29.714739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a0cd9805-1b5e-49fe-b9dc-25572b05e655 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:29.715329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a0cd9805-1b5e-49fe-b9dc-25572b05e655 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:29.720906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0cd9805-1b5e-49fe-b9dc-25572b05e655 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.721348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0cd9805-1b5e-49fe-b9dc-25572b05e655 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:29.722115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0cd9805-1b5e-49fe-b9dc-25572b05e655 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.722522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a0cd9805-1b5e-49fe-b9dc-25572b05e655 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:29.853709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a0cd9805-1b5e-49fe-b9dc-25572b05e655 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:29.861117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a0cd9805-1b5e-49fe-b9dc-25572b05e655 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1557 microversion: 2.1 time: 0.149745 Jun 27 15:01:29.861676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 607/857] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:29 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:29.877180 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2fc142b9-3087-4b67-9dfa-d0fd7ba6c9fc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:29.877662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2fc142b9-3087-4b67-9dfa-d0fd7ba6c9fc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:29.883609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2fc142b9-3087-4b67-9dfa-d0fd7ba6c9fc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.884048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2fc142b9-3087-4b67-9dfa-d0fd7ba6c9fc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:29.884836 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2fc142b9-3087-4b67-9dfa-d0fd7ba6c9fc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.885259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2fc142b9-3087-4b67-9dfa-d0fd7ba6c9fc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:29.968709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2fc142b9-3087-4b67-9dfa-d0fd7ba6c9fc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095567 Jun 27 15:01:29.969509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 608/858] 10.222.0.44 () {58 vars in 1274 bytes} [Mon Jun 27 15:01:29 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:01:29.973966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:29.978003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:29.981028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.981472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:29.982233 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:29.982663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:30.125885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:30.134575 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:30.136057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:30.137244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3f9dcf95-8dd8-4a73-88a5-d7430226ceeb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1744 microversion: 2.20 time: 0.167016 Jun 27 15:01:30.137783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 609/859] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:29 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:30.572039 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3cab1225-61e5-47bc-9883-d9909e1b0fe1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:30.572735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3cab1225-61e5-47bc-9883-d9909e1b0fe1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:30.579160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cab1225-61e5-47bc-9883-d9909e1b0fe1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:30.579605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cab1225-61e5-47bc-9883-d9909e1b0fe1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:30.580358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cab1225-61e5-47bc-9883-d9909e1b0fe1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:30.580820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cab1225-61e5-47bc-9883-d9909e1b0fe1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:30.734064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3cab1225-61e5-47bc-9883-d9909e1b0fe1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:30.742107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3cab1225-61e5-47bc-9883-d9909e1b0fe1 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1514 microversion: 2.1 time: 0.174608 Jun 27 15:01:30.742678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 610/860] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:30 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:30.747106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e698cd37-4b65-4ea7-bf48-20358c4a2ff2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:30.747703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e698cd37-4b65-4ea7-bf48-20358c4a2ff2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:30.769362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e698cd37-4b65-4ea7-bf48-20358c4a2ff2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:30.770007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e698cd37-4b65-4ea7-bf48-20358c4a2ff2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:30.770946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e698cd37-4b65-4ea7-bf48-20358c4a2ff2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:30.771535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e698cd37-4b65-4ea7-bf48-20358c4a2ff2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:30.942388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e698cd37-4b65-4ea7-bf48-20358c4a2ff2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:30.950151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e698cd37-4b65-4ea7-bf48-20358c4a2ff2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.206421 Jun 27 15:01:30.959983 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 611/861] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:30 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:31.012948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-6ac28a9c-a60f-4458-b4e1-c30b443c855b req-52b8053f-a055-4324-8dbe-054c244720d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3162d971-6d40-49fc-adc7-0f702415b9e6", "name": "network-vif-deleted", "tag": "4a0ef132-1922-4203-b6f8-7ab0a4f99254"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:31.021765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6ac28a9c-a60f-4458-b4e1-c30b443c855b req-52b8053f-a055-4324-8dbe-054c244720d8 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:31.022405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6ac28a9c-a60f-4458-b4e1-c30b443c855b req-52b8053f-a055-4324-8dbe-054c244720d8 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:31.035302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-6ac28a9c-a60f-4458-b4e1-c30b443c855b req-52b8053f-a055-4324-8dbe-054c244720d8 service nova] Creating event network-vif-deleted:4a0ef132-1922-4203-b6f8-7ab0a4f99254 for instance 3162d971-6d40-49fc-adc7-0f702415b9e6 on hv-cinder-79760 Jun 27 15:01:31.041606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-6ac28a9c-a60f-4458-b4e1-c30b443c855b req-52b8053f-a055-4324-8dbe-054c244720d8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089767 Jun 27 15:01:31.042514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 612/862] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:01:31.118646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-051ba060-e660-449b-ad98-36ddf8429377 req-b9559232-0030-4017-b44b-cd02114766b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc6fa5c-6fa8-4071-a3c0-b52e14b64164", "tag": "f1cf490b-64aa-49c5-a8ae-c54863aae7cc"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:31.126817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-051ba060-e660-449b-ad98-36ddf8429377 req-b9559232-0030-4017-b44b-cd02114766b8 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:31.127265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-051ba060-e660-449b-ad98-36ddf8429377 req-b9559232-0030-4017-b44b-cd02114766b8 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:31.138303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-051ba060-e660-449b-ad98-36ddf8429377 req-b9559232-0030-4017-b44b-cd02114766b8 service nova] Creating event network-changed:f1cf490b-64aa-49c5-a8ae-c54863aae7cc for instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 on hv-cinder-79760 Jun 27 15:01:31.143207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-051ba060-e660-449b-ad98-36ddf8429377 req-b9559232-0030-4017-b44b-cd02114766b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089617 Jun 27 15:01:31.143809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 613/863] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:01:31.155467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:31.156154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:31.162489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:31.163729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:31.164514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:31.164962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:31.294121 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:31.302123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:31.305588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:31.305588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c7fabb30-7c3a-44bc-924c-4e4c0fb89f3a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1744 microversion: 2.20 time: 0.153713 Jun 27 15:01:31.305807 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 614/864] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:31 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:31.759406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-598fe093-10df-4795-b84b-843e6c436774 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:31.760781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-598fe093-10df-4795-b84b-843e6c436774 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:31.767758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-598fe093-10df-4795-b84b-843e6c436774 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:31.768928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-598fe093-10df-4795-b84b-843e6c436774 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:31.769411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-598fe093-10df-4795-b84b-843e6c436774 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:31.770189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-598fe093-10df-4795-b84b-843e6c436774 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:31.869552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-598fe093-10df-4795-b84b-843e6c436774 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:31.877982 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-598fe093-10df-4795-b84b-843e6c436774 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1304 microversion: 2.1 time: 0.122847 Jun 27 15:01:31.880687 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 615/865] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:31 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:31.967767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-de376e4d-c887-4b2d-814a-fe48567e1a33 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:31.968507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-de376e4d-c887-4b2d-814a-fe48567e1a33 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:31.975441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de376e4d-c887-4b2d-814a-fe48567e1a33 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:31.975893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de376e4d-c887-4b2d-814a-fe48567e1a33 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:31.976686 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de376e4d-c887-4b2d-814a-fe48567e1a33 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:31.977153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de376e4d-c887-4b2d-814a-fe48567e1a33 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:32.124045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-de376e4d-c887-4b2d-814a-fe48567e1a33 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:32.133044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-de376e4d-c887-4b2d-814a-fe48567e1a33 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1359 microversion: 2.1 time: 0.169452 Jun 27 15:01:32.136686 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 616/866] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:31 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:32.196801 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-bc06a8fe-003a-4710-93ab-8a46161e296c req-6c7dba0d-0244-460c-ab3b-19a571269d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67eac8a-bfba-489d-8d6d-11956e1b4e90", "name": "network-vif-plugged", "status": "completed", "tag": "2f2fac3d-9b57-4c4a-a63d-b53b86aca080"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:32.205676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-bc06a8fe-003a-4710-93ab-8a46161e296c req-6c7dba0d-0244-460c-ab3b-19a571269d7e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:32.206239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-bc06a8fe-003a-4710-93ab-8a46161e296c req-6c7dba0d-0244-460c-ab3b-19a571269d7e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:32.218861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-bc06a8fe-003a-4710-93ab-8a46161e296c req-6c7dba0d-0244-460c-ab3b-19a571269d7e service nova] Creating event network-vif-plugged:2f2fac3d-9b57-4c4a-a63d-b53b86aca080 for instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 on hv-cinder-79760 Jun 27 15:01:32.224019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-bc06a8fe-003a-4710-93ab-8a46161e296c req-6c7dba0d-0244-460c-ab3b-19a571269d7e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031821 Jun 27 15:01:32.225732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 617/867] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:01:32.328371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:32.329324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:32.336047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:32.336976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:32.337364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:32.337802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:32.491652 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:32.499855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:32.501385 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:32.502685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8b878796-9bf0-4490-bb18-fd0a376e74ff tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1744 microversion: 2.20 time: 0.182756 Jun 27 15:01:32.503244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 618/868] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:32 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:32.895915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:32.896676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:32.903664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:32.904141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:32.904921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:32.905353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:32.935294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:32.935661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:32.936363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lazy-loading 'fault' on Instance uuid 3162d971-6d40-49fc-adc7-0f702415b9e6 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:01:32.979168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c4678d1aa9425db97adc6cce76e74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f69fa608db4724a066a8dde7efe38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:32.986522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e718c968-9cfd-490f-8c9d-d4abdd68f212 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 200 len: 1309 microversion: 2.1 time: 0.094501 Jun 27 15:01:32.987083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 619/869] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:32 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:33.154497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9d32aa17-d91b-464b-b199-1761d1549b55 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:33.155924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9d32aa17-d91b-464b-b199-1761d1549b55 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:33.163649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9d32aa17-d91b-464b-b199-1761d1549b55 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.164102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9d32aa17-d91b-464b-b199-1761d1549b55 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:33.164913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9d32aa17-d91b-464b-b199-1761d1549b55 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.165349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9d32aa17-d91b-464b-b199-1761d1549b55 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:33.347466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9d32aa17-d91b-464b-b199-1761d1549b55 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:33.355384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9d32aa17-d91b-464b-b199-1761d1549b55 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1550 microversion: 2.1 time: 0.209445 Jun 27 15:01:33.356292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 620/870] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:33 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1550 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:33.371850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6921ce61-c27f-40ae-a303-88a2149edde0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:33.372450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6921ce61-c27f-40ae-a303-88a2149edde0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:33.378261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6921ce61-c27f-40ae-a303-88a2149edde0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.379370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6921ce61-c27f-40ae-a303-88a2149edde0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:33.379503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6921ce61-c27f-40ae-a303-88a2149edde0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.379884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6921ce61-c27f-40ae-a303-88a2149edde0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:33.511897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6921ce61-c27f-40ae-a303-88a2149edde0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:33.519934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6921ce61-c27f-40ae-a303-88a2149edde0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1550 microversion: 2.1 time: 0.151932 Jun 27 15:01:33.520713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 621/871] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:33 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:33.525588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:33.526189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:33.532135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.532577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:33.533358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.533789 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:33.661782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:33.669651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:33.671163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:33.672274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-978997f7-d2f8-48b1-9a39-9d3a5194410b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1744 microversion: 2.20 time: 0.150599 Jun 27 15:01:33.672845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 622/872] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:33 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:33.677443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c7c22de5-31c8-4f7b-a705-41420b0d7c23 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:33.681118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c7c22de5-31c8-4f7b-a705-41420b0d7c23 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:33.681866 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c7c22de5-31c8-4f7b-a705-41420b0d7c23 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Searching by: {'deleted': False, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c'} {{(pid=129687) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 27 15:01:33.688362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7c22de5-31c8-4f7b-a705-41420b0d7c23 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.688859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7c22de5-31c8-4f7b-a705-41420b0d7c23 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:33.689683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7c22de5-31c8-4f7b-a705-41420b0d7c23 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.690107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c7c22de5-31c8-4f7b-a705-41420b0d7c23 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:33.777088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.multi_cell_list [None req-c7c22de5-31c8-4f7b-a705-41420b0d7c23 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129687) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 27 15:01:33.801949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:33.871316 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c7c22de5-31c8-4f7b-a705-41420b0d7c23 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197354 Jun 27 15:01:33.871791 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 623/873] 10.222.0.44 () {58 vars in 1124 bytes} [Mon Jun 27 15:01:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:01:33.881314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-69a7ed80-1f70-47c8-ad8f-46716af6fe16 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:33.881909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-69a7ed80-1f70-47c8-ad8f-46716af6fe16 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:33.887869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69a7ed80-1f70-47c8-ad8f-46716af6fe16 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.888306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69a7ed80-1f70-47c8-ad8f-46716af6fe16 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:33.889100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69a7ed80-1f70-47c8-ad8f-46716af6fe16 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:33.889534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69a7ed80-1f70-47c8-ad8f-46716af6fe16 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:34.017719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-69a7ed80-1f70-47c8-ad8f-46716af6fe16 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:34.024981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-69a7ed80-1f70-47c8-ad8f-46716af6fe16 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1550 microversion: 2.1 time: 0.147155 Jun 27 15:01:34.025543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 624/874] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:33 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1550 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:34.029845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:34.030438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] [instance: 3162d971-6d40-49fc-adc7-0f702415b9e6] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:34.035811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:34.036259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:34.037039 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:34.037959 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:34.051282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] HTTP exception thrown: Instance 3162d971-6d40-49fc-adc7-0f702415b9e6 could not be found. Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Request method failure captured: Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 HTTP/1.1 Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucUmIJKZJHeCrIGWnP6WkJYxeNaIdgXmzC8kJmlz093eJwWYSX4mCk4YjvXk-aObGQEtGfR-kUJFlugyPanmUPX_x4N_0L7fAOzOA0eHIlUKoQpfL3Hx8J6z7cl07Jgs65FQkI4dyEjgrl0gfntnxK5DkG4gVlGxrkHoxovO301stf8 Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 88f69fa608db4724a066a8dde7efe38a Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2023575950 Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:01:34.052916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_88f69fa608db4724a066a8dde7efe38a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88f69fa608db4724a066a8dde7efe38a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/88f69fa608db4724a066a8dde7efe38a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88f69fa608db4724a066a8dde7efe38a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesSnapshotTestJSON-2023575950 Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 88f69fa608db4724a066a8dde7efe38a Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2023575950 Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesSnapshotTestJSON-2023575950-project Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: e7c4678d1aa9425db97adc6cce76e74f Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesSnapshotTestJSON-2023575950-project Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 3162d971-6d40-49fc-adc7-0f702415b9e6 could not be found. Jun 27 15:01:34.054531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '3162d971-6d40-49fc-adc7-0f702415b9e6'} Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3162d971-6d40-49fc-adc7-0f702415b9e6 could not be found. Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:01:34.055447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3162d971-6d40-49fc-adc7-0f702415b9e6 could not be found. Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3162d971-6d40-49fc-adc7-0f702415b9e6 could not be found. Jun 27 15:01:34.057567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:01:34.060044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] Returning 404 to user: Instance 3162d971-6d40-49fc-adc7-0f702415b9e6 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:01:34.060044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-af3a6af4-a014-47da-8acc-7858ec64b4c7 tempest-VolumesSnapshotTestJSON-2023575950 tempest-VolumesSnapshotTestJSON-2023575950-project] 10.222.0.44 "GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6" status: 404 len: 111 microversion: 2.1 time: 0.028017 Jun 27 15:01:34.060044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 625/875] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:34 2022] GET /compute/v2.1/servers/3162d971-6d40-49fc-adc7-0f702415b9e6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:01:34.691378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:34.691971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:34.697861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:34.698306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:34.699065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:34.699471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:34.843383 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:34.852153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:34.853709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:34.854855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9613c52b-9da3-47a9-8d1b-248a3e6a6c70 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1744 microversion: 2.20 time: 0.167252 Jun 27 15:01:34.855788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 626/876] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:34 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:35.873636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:35.874255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:35.880795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:35.881954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:35.882929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:35.883369 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:36.013522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:36.021705 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:36.023445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:36.024629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4649d692-7f92-4416-b862-45b78a421884 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1744 microversion: 2.20 time: 0.154925 Jun 27 15:01:36.025199 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 627/877] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:35 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:37.042737 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:37.043349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:37.050513 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:37.051038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:37.051798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:37.052222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:37.185454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:37.193551 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:37.195051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:37.196186 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-17ec8d56-de27-4161-8c5d-94eeff7555c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1744 microversion: 2.20 time: 0.157768 Jun 27 15:01:37.196797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 628/878] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:37 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:37.201559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-04fbec73-77b1-4f86-81a1-3d729aca9c66 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa108b6f-9bb1-4134-84ab-f99c013d238f"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:37.202626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-04fbec73-77b1-4f86-81a1-3d729aca9c66 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:37.208426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04fbec73-77b1-4f86-81a1-3d729aca9c66 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:37.208951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04fbec73-77b1-4f86-81a1-3d729aca9c66 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:37.210394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04fbec73-77b1-4f86-81a1-3d729aca9c66 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:37.210830 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04fbec73-77b1-4f86-81a1-3d729aca9c66 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:38.031556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-04fbec73-77b1-4f86-81a1-3d729aca9c66 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "POST /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833464 Jun 27 15:01:38.032584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 629/879] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:01:37 2022] POST /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:01:38.215325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:38.216731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:38.225178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:38.225939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:38.226899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:38.227485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:38.373990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:38.382805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:38.384301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:38.385475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4b8a5278-38ab-49d7-85fb-811a43ee1d14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.174430 Jun 27 15:01:38.386032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 630/880] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:38 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:39.403580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:39.405105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:39.411166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:39.413302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:39.413820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:39.414661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:39.415296 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:39.578247 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:39.587015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:39.588477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:39.589671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5d6e8dc5-b865-4e53-b557-7fafa186a15f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.189970 Jun 27 15:01:39.600833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 631/881] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:39 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:40.607262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:40.607998 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:40.614377 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:40.615106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:40.616222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:40.616943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:40.763096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:40.775885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:40.777440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:40.778924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c78805fc-8896-4d99-9f9f-ea9d74a1de00 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.175601 Jun 27 15:01:40.780155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 632/882] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:40 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:41.797641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:41.798360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:41.805118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:41.805918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:41.806692 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:41.807124 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:41.951074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:41.959770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:41.961399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:41.962910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b0ed3aa2-328b-4364-8caa-ac4e990af38f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.169214 Jun 27 15:01:41.963459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 633/883] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:41 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:42.982248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:42.982945 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:42.995318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:42.996237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:42.997623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:42.998636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:43.182966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:43.196096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:43.198784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:43.200860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-577088d3-8177-4edd-b5fe-6d4b143da663 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.222604 Jun 27 15:01:43.202437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 634/884] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:42 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:44.221688 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:44.222449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:44.224044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:44.229810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:44.230252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:44.230998 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:44.231424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:44.397684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:44.405625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:44.407132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:44.408293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-35c8ce28-4681-4573-a94f-365c600b4e7e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.190646 Jun 27 15:01:44.408884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 635/885] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:44 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:45.426116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:45.427544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:45.437355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:45.438038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:45.438952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:45.439562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:45.602626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:45.612619 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:45.614469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:45.615719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c9437abb-2a2b-4dc6-b5ef-4b7555437460 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.193420 Jun 27 15:01:45.620680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 636/886] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:45 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:46.635232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:46.636059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:46.643144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:46.643904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:46.644918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:46.645545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:46.808110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:46.817165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:46.818707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:46.820814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-286370c5-e8d7-4bac-90c6-096cb634ed57 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.190117 Jun 27 15:01:46.821356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 637/887] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:46 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:47.839498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:47.840211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:47.846668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:47.847201 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:47.848276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:47.848738 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:47.984911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:47.993533 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:47.995049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:47.996218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-35868870-a9a0-48dc-b3ff-20d748c1fe28 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.160847 Jun 27 15:01:48.002648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 638/888] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:47 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:49.013651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:49.014220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:49.020525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:49.020993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:49.021735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:49.022159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:49.026032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:49.154354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:49.162004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:49.164129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:49.165295 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b0f1769d-6dbc-447a-bd3b-b223d1ad5b7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.155526 Jun 27 15:01:49.165846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 639/889] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:49 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:50.183875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:50.184899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:50.191212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:50.191660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:50.192445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:50.192910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:50.322223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:50.330070 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:50.331606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:50.332782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c4115b72-6e1e-476c-8050-e2abfd5ca33e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1739 microversion: 2.20 time: 0.152880 Jun 27 15:01:50.333335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 640/890] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:50 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:51.351078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:51.351718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:51.358075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:51.358524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:51.359268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:51.359691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:51.488517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:51.496864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:51.498343 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:51.499492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-785da304-4037-4058-8d09-984623c3163c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1721 microversion: 2.20 time: 0.152658 Jun 27 15:01:51.500043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 641/891] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:51 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:51.945320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6b939c75-4d68-4655-975a-27e1eaceb598 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:51.945877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6b939c75-4d68-4655-975a-27e1eaceb598 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:51.951726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6b939c75-4d68-4655-975a-27e1eaceb598 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:51.952166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6b939c75-4d68-4655-975a-27e1eaceb598 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:51.952946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6b939c75-4d68-4655-975a-27e1eaceb598 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:51.953371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6b939c75-4d68-4655-975a-27e1eaceb598 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:52.080971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6b939c75-4d68-4655-975a-27e1eaceb598 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:52.089942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6b939c75-4d68-4655-975a-27e1eaceb598 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1596 microversion: 2.1 time: 0.148567 Jun 27 15:01:52.090522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 642/892] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:51 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1596 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:01:52.518798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:52.519415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:52.526874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:52.527325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:52.528091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:52.528522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:52.745225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:52.753682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:52.755113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:52.756270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-586837cc-4392-496d-873d-844115830fe0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1721 microversion: 2.20 time: 0.241452 Jun 27 15:01:52.757034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 643/893] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:52 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:53.774391 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:53.775046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:53.781455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:53.781902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:53.782659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:53.783093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:54.014567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:54.022299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:54.023790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:54.024962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fbc0b0a3-d472-4abd-a810-3859768b085d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1721 microversion: 2.20 time: 0.254448 Jun 27 15:01:54.025516 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 644/894] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:53 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:54.482042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-ffb758d5-faaf-4c04-9714-4a26e853bf50 req-8a109c2c-6176-43ea-84e3-39371bd0c1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f21014-5688-42b2-990a-51b99ff11e91", "tag": "53878d21-1d99-4fed-a685-f691228ebaa2"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:54.491756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-ffb758d5-faaf-4c04-9714-4a26e853bf50 req-8a109c2c-6176-43ea-84e3-39371bd0c1bd service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:54.492555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-ffb758d5-faaf-4c04-9714-4a26e853bf50 req-8a109c2c-6176-43ea-84e3-39371bd0c1bd service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:54.507680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-ffb758d5-faaf-4c04-9714-4a26e853bf50 req-8a109c2c-6176-43ea-84e3-39371bd0c1bd service nova] Creating event network-changed:53878d21-1d99-4fed-a685-f691228ebaa2 for instance c2f21014-5688-42b2-990a-51b99ff11e91 on hv-cinder-79760 Jun 27 15:01:54.512844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-ffb758d5-faaf-4c04-9714-4a26e853bf50 req-8a109c2c-6176-43ea-84e3-39371bd0c1bd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034458 Jun 27 15:01:54.513461 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 645/895] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:01:55.044452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:55.045346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:55.052348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:55.052969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:55.054446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:55.054995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:55.267885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:55.278599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:55.281006 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:55.282483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5013a7fd-1ce9-4969-95aa-79fa6f85a068 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1721 microversion: 2.20 time: 0.242691 Jun 27 15:01:55.283501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 646/896] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:55 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:55.848149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-9626e712-58b5-411f-b63b-10c3dd5f68fb req-5eec555c-681f-443a-9765-160a115925cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67eac8a-bfba-489d-8d6d-11956e1b4e90", "name": "network-vif-unplugged", "status": "completed", "tag": "2f2fac3d-9b57-4c4a-a63d-b53b86aca080"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:55.863730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-9626e712-58b5-411f-b63b-10c3dd5f68fb req-5eec555c-681f-443a-9765-160a115925cf service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:55.863730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-9626e712-58b5-411f-b63b-10c3dd5f68fb req-5eec555c-681f-443a-9765-160a115925cf service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:55.872010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-9626e712-58b5-411f-b63b-10c3dd5f68fb req-5eec555c-681f-443a-9765-160a115925cf service nova] Creating event network-vif-unplugged:2f2fac3d-9b57-4c4a-a63d-b53b86aca080 for instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 on hv-cinder-79760 Jun 27 15:01:55.877172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-9626e712-58b5-411f-b63b-10c3dd5f68fb req-5eec555c-681f-443a-9765-160a115925cf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091128 Jun 27 15:01:55.877773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 647/897] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:01:56.303164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:56.303903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:56.310047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:56.314268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:56.314268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:56.314268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:56.445624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:56.453603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:56.455169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:56.456347 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5f06b8f0-eafc-4d89-a069-781b2c9e39fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1721 microversion: 2.20 time: 0.157924 Jun 27 15:01:56.456934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 648/898] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:56 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:57.084848 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b318a5bb-acbe-4a25-a472-0e6135867951 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-859754205"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:57.085423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b318a5bb-acbe-4a25-a472-0e6135867951 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:57.091602 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b318a5bb-acbe-4a25-a472-0e6135867951 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:57.092054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b318a5bb-acbe-4a25-a472-0e6135867951 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:57.092887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b318a5bb-acbe-4a25-a472-0e6135867951 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:57.093322 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b318a5bb-acbe-4a25-a472-0e6135867951 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:57.224586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.network.security_group_api [None req-b318a5bb-acbe-4a25-a472-0e6135867951 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Adding security group cac1aae4-34fe-435d-8bab-7a33fc145dc6 to port 53878d21-1d99-4fed-a685-f691228ebaa2 Jun 27 15:01:57.658054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b318a5bb-acbe-4a25-a472-0e6135867951 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "POST /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/action" status: 202 len: 0 microversion: 2.1 time: 0.576930 Jun 27 15:01:57.660178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 649/899] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:01:57 2022] POST /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:01:57.669122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:57.669775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:57.677490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:57.677936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:57.680971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:57.681767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:57.847488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:57.857143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:57.859189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:57.860495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-abf99f67-4a50-41ea-a505-4eb2bc4f6f11 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1721 microversion: 2.20 time: 0.195257 Jun 27 15:01:57.861084 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 650/900] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:57 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:01:57.866059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a13aec3-4d97-4f33-a012-2ab27a2ca645 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:57.867396 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5a13aec3-4d97-4f33-a012-2ab27a2ca645 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:57.875207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a13aec3-4d97-4f33-a012-2ab27a2ca645 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:57.875654 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a13aec3-4d97-4f33-a012-2ab27a2ca645 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:57.876444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a13aec3-4d97-4f33-a012-2ab27a2ca645 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:57.876904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a13aec3-4d97-4f33-a012-2ab27a2ca645 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:58.029420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5a13aec3-4d97-4f33-a012-2ab27a2ca645 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:58.037903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5a13aec3-4d97-4f33-a012-2ab27a2ca645 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1761 microversion: 2.1 time: 0.175458 Jun 27 15:01:58.038632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 651/901] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:01:57 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1761 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:01:58.043343 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-43176c31-fe23-420e-a241-b0b8a5ab32fe req-640c92a9-6b99-4fa7-8e34-c16964c26d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f21014-5688-42b2-990a-51b99ff11e91", "tag": "53878d21-1d99-4fed-a685-f691228ebaa2"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:58.052334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-43176c31-fe23-420e-a241-b0b8a5ab32fe req-640c92a9-6b99-4fa7-8e34-c16964c26d88 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:58.053076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-43176c31-fe23-420e-a241-b0b8a5ab32fe req-640c92a9-6b99-4fa7-8e34-c16964c26d88 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:58.064901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-43176c31-fe23-420e-a241-b0b8a5ab32fe req-640c92a9-6b99-4fa7-8e34-c16964c26d88 service nova] Creating event network-changed:53878d21-1d99-4fed-a685-f691228ebaa2 for instance c2f21014-5688-42b2-990a-51b99ff11e91 on hv-cinder-79760 Jun 27 15:01:58.071429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-43176c31-fe23-420e-a241-b0b8a5ab32fe req-640c92a9-6b99-4fa7-8e34-c16964c26d88 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030864 Jun 27 15:01:58.072477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 652/902] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:01:58.879675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:01:58.880388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:58.887291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:58.887733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:58.888484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:58.889173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:59.018639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:59.027519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:59.029109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:01:59.032024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-55a4fb55-cb6a-43e3-a673-2b3e76786303 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1664 microversion: 2.20 time: 0.155147 Jun 27 15:01:59.032024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 653/903] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:01:58 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:01:59.047834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5cd607b5-53be-40c1-841f-4a68dd2bd404 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12d6dae0-7080-44cd-ab30-337bb16e04e9"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:01:59.048991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5cd607b5-53be-40c1-841f-4a68dd2bd404 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:01:59.054974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5cd607b5-53be-40c1-841f-4a68dd2bd404 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:59.055419 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5cd607b5-53be-40c1-841f-4a68dd2bd404 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:01:59.056169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5cd607b5-53be-40c1-841f-4a68dd2bd404 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:01:59.056599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5cd607b5-53be-40c1-841f-4a68dd2bd404 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:00.039534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5cd607b5-53be-40c1-841f-4a68dd2bd404 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.995317 Jun 27 15:02:00.040214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 654/904] 10.222.0.44 () {62 vars in 1363 bytes} [Mon Jun 27 15:01:59 2022] POST /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments => generated 188 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:02:00.151868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bde31680-aa81-4d12-95ac-9e5713c54798 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:02:00.152458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bde31680-aa81-4d12-95ac-9e5713c54798 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:00.158549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bde31680-aa81-4d12-95ac-9e5713c54798 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:00.158989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bde31680-aa81-4d12-95ac-9e5713c54798 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:00.159745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bde31680-aa81-4d12-95ac-9e5713c54798 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:00.160177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bde31680-aa81-4d12-95ac-9e5713c54798 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:00.177821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:00.488630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bde31680-aa81-4d12-95ac-9e5713c54798 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/action" status: 202 len: 0 microversion: 2.20 time: 0.341164 Jun 27 15:02:00.489361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 655/905] 10.222.0.44 () {62 vars in 1318 bytes} [Mon Jun 27 15:02:00 2022] POST /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:02:00.498095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:00.498706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:00.504771 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:00.505225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:00.505987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:00.506420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:00.641397 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:00.650595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:00.652141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:00.656786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-352f457f-81a7-47b4-bd0f-43964be8e317 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1750 microversion: 2.20 time: 0.159160 Jun 27 15:02:00.656786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 656/906] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:00 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:01.671440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:01.672100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:01.678445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:01.679186 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:01.679967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:01.680378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:01.817645 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:01.826739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:01.828217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:01.829397 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-244d0470-ba25-4952-9453-d8a80792c5f4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1750 microversion: 2.20 time: 0.161937 Jun 27 15:02:01.830094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 657/907] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:01 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:02.847640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:02.848374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:02.855635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:02.856076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:02.856868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:02.857299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:02.984210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:02.992595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:02.994121 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:02.995373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2a3e2b41-a2b8-4a85-ae8c-af5145007651 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1752 microversion: 2.20 time: 0.151648 Jun 27 15:02:02.995930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 658/908] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:02 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:04.013835 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:04.014535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:04.020950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:04.021400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:04.022254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:04.022693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:04.160071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:04.168566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:04.170081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:04.171226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c2120c3f-c6f9-43a2-9910-06cd6c52a690 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1752 microversion: 2.20 time: 0.161550 Jun 27 15:02:04.171787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 659/909] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:04 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:05.190260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:05.190903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:05.198561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:05.199007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:05.199760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:05.200190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:05.330613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:05.339213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:05.341691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:05.343292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d1ab7d58-648d-402b-966e-baebfadbaef3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.156990 Jun 27 15:02:05.343902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 660/910] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:05 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:06.361489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:06.362429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:06.368854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:06.369294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:06.370064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:06.370471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:06.510039 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:06.518491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:06.520025 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:06.521182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b381bbd1-8ffe-420f-955c-4ef221539a87 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.163578 Jun 27 15:02:06.521924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 661/911] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:06 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:02:07.540411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:07.541076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:07.547800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:07.548250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:07.549056 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:07.549546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:07.704991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:07.714278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:07.715831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:07.717014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-068f9df1-5ea7-4188-92eb-cfd69bb865ba tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.181468 Jun 27 15:02:07.717774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 662/912] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:07 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:08.736114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:08.736903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:08.743722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:08.744168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:08.744973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:08.745406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:08.938763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:08.948452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:08.949989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:08.951203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7785dbd7-dc9b-4f14-b7a9-f4be98acdbd1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.219052 Jun 27 15:02:08.951763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 663/913] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:08 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:09.969723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:09.970376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:09.972635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=68 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:09.979590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:09.979958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:09.980775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:09.981210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:10.190403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:10.190403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:10.190693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:10.190693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0088b9a7-5bd5-4e7a-b3d8-46276e7d196e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.201470 Jun 27 15:02:10.190693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 664/914] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:09 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:11.204718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:11.206192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:11.219824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:11.219824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:11.219824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:11.219824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:11.359272 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:11.367884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:11.369700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:11.370951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-77737653-1516-4d1a-846f-d0129fee0958 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.170297 Jun 27 15:02:11.371612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 665/915] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:11 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:12.392109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:12.392109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:12.398014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:12.398493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:12.399814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:12.400248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:12.561185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:12.561185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:12.561522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:12.561522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bc3c11ed-9d41-476d-9341-2134244a54f1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.174522 Jun 27 15:02:12.561698 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 666/916] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:12 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:02:13.579276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:13.580075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:13.587780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:13.588408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:13.589201 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:13.589662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:13.725429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:13.734665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:13.736145 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:13.737334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5fa95e50-9799-4411-84fe-bf9e78d13b76 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.161937 Jun 27 15:02:13.737889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 667/917] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:13 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:14.755349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:14.756098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:14.763614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:14.764073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:14.764875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:14.765310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:14.902631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:14.911510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:14.913034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:14.914198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bcf37923-e7d4-48ff-be32-c0b502c3a1ea tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.162842 Jun 27 15:02:14.915730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 668/918] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:14 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:15.933050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:15.933804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:15.940515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:15.940997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:15.941761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:15.942197 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:16.079790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:16.089179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:16.091241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:16.092422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-863ea063-1b3c-4b4d-b437-07ef003b04cf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.163429 Jun 27 15:02:16.093033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 669/919] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:15 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:17.112155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:17.112833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:17.119478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:17.119950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:17.121522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:17.121976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:17.250421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:17.258801 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:17.260298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:17.261478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ec753917-e602-44f5-9699-10f0f8d9e898 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.153397 Jun 27 15:02:17.262031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 670/920] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:17 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:18.279421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:18.280060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:18.286675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:18.287114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:18.287857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:18.288282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:18.292664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:18.423218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:18.431384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:18.433526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:18.434707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bef65486-65e9-4cfb-ae0f-de2664a5cd32 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.159214 Jun 27 15:02:18.435545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 671/921] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:18 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:19.453586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:19.454254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:19.460734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:19.461181 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:19.461963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:19.462397 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:19.594275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:19.602950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:19.604438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:19.605621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-52044fdc-caed-4e5a-b457-4031b57211c6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.156043 Jun 27 15:02:19.606167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 672/922] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:19 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:20.623734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:20.624366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:20.630798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:20.631256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:20.632014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:20.632446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:20.763438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:20.771811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:20.773345 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:20.774497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a8695ff8-bcc1-47bf-a23e-bda07d6feb14 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.154939 Jun 27 15:02:20.775058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 673/923] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:20 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:21.793967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:21.794568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:21.800948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:21.801392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:21.802140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:21.802572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:21.930718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:21.939421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:21.940930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:21.942077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0ba1f2b3-e64f-4855-a222-84fb01d25922 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.152863 Jun 27 15:02:21.942633 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 674/924] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:21 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:22.960250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:22.960912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:22.967506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:22.967949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:22.968728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:22.969161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:23.096031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:23.105203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:23.106744 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:23.108473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3995a814-8e1a-43c1-87bd-00222a3bb65e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.151582 Jun 27 15:02:23.108583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 675/925] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:22 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:24.126243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:24.126844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:24.133327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:24.137200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:24.137200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:24.137200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:24.269460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:24.277931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:24.279419 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:24.280561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-044dfa0a-a75b-471d-b922-690e427cf09c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.158304 Jun 27 15:02:24.281144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 676/926] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:24 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:02:25.298825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:25.299485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:25.305995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:25.312809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:25.312809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:25.312809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:25.438476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:25.446931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:25.451500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:25.451500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-01bd1c02-8c1e-455f-8b8d-213f77d155a8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.155686 Jun 27 15:02:25.451500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 677/927] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:25 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:26.469115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:26.469758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:26.476086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:26.476534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:26.477329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:26.477768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:26.615499 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:26.624906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:26.626398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:26.627585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8cfe3496-b74c-4ead-a843-92d34544736d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.163339 Jun 27 15:02:26.628152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 678/928] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:26 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:27.645814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:27.646473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:27.653218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:27.653666 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:27.654442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:27.654873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:27.785774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:27.790497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:27.791994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:27.793905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-008da2b0-df1f-4bf5-bbe9-d7b84ccfc43b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.151899 Jun 27 15:02:27.794471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 679/929] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:27 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:28.813404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:28.814007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:28.820425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:28.820897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:28.821647 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:28.822076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:28.952472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:28.960813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:28.962321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:28.963498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-833214d1-969e-4744-b2eb-f13232dd0aad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.156172 Jun 27 15:02:28.964061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 680/930] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:28 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:29.983017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:29.983628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:29.990114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:29.990558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:29.991314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:29.991778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:30.119402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:30.128129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:30.129656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:30.130814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f6c271a5-6e8b-482d-8fa2-7f04bdd8c450 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.152620 Jun 27 15:02:30.131372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 681/931] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:29 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:31.148200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:31.148822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:31.155422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:31.155863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:31.156606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:31.157053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:31.288167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:31.297270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:31.298772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:31.299912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fc785b70-9c80-4c26-9cad-14c1778d7e1b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.155597 Jun 27 15:02:31.300482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 682/932] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:31 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:32.318603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:32.319207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:32.326500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:32.326948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:32.327804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:32.328263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:32.453892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:32.464488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:32.466063 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:32.467233 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-aa7d05d6-64e3-49b0-86fa-61e3167a2f94 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.152553 Jun 27 15:02:32.467797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 683/933] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:32 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:33.485506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:33.486109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:33.492535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:33.493011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:33.493752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:33.494177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:33.623787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:33.632073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:33.633680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:33.634889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4c1e8f51-5bbf-4777-815d-218547216e22 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.153317 Jun 27 15:02:33.635449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 684/934] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:33 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:02:34.165758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-03d3acb0-bfd7-4d12-bf11-8c0c946bfa1e req-9ac731af-68b7-43d5-af86-2eaa0251f275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67eac8a-bfba-489d-8d6d-11956e1b4e90", "name": "network-vif-plugged", "status": "completed", "tag": "2f2fac3d-9b57-4c4a-a63d-b53b86aca080"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:02:34.174216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-03d3acb0-bfd7-4d12-bf11-8c0c946bfa1e req-9ac731af-68b7-43d5-af86-2eaa0251f275 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:34.174690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-03d3acb0-bfd7-4d12-bf11-8c0c946bfa1e req-9ac731af-68b7-43d5-af86-2eaa0251f275 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:34.186369 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-03d3acb0-bfd7-4d12-bf11-8c0c946bfa1e req-9ac731af-68b7-43d5-af86-2eaa0251f275 service nova] Creating event network-vif-plugged:2f2fac3d-9b57-4c4a-a63d-b53b86aca080 for instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 on hv-cinder-79760 Jun 27 15:02:34.191448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-03d3acb0-bfd7-4d12-bf11-8c0c946bfa1e req-9ac731af-68b7-43d5-af86-2eaa0251f275 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029290 Jun 27 15:02:34.192041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 685/935] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:02:34.655289 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:34.656011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:34.662190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:34.662633 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:34.663381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:34.663810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:34.799480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:34.807687 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:34.809398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:34.810813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-69fe105f-fa7c-490b-861b-1ab2f67abc5d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.161124 Jun 27 15:02:34.811366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 686/936] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:34 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:35.829036 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:35.829709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:35.836110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:35.836557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:35.837350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:35.837788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:35.967546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:35.975918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:35.977453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:35.978611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a892723d-6675-46d1-9c76-b308770f508a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.153486 Jun 27 15:02:35.979179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 687/937] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:35 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:36.997980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:36.997980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:37.003877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:37.004325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:37.005105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:37.005537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:37.023628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:37.143330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:37.152313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:37.154428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:37.155615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e86cd9da-c8ac-4d10-bd7c-2d2c89bb8871 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1808 microversion: 2.20 time: 0.162469 Jun 27 15:02:37.156215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 688/938] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:36 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:02:38.175067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:02:38.175770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:02:38.182360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:38.182808 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:38.183566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:02:38.183994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:02:38.313463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:38.321839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:38.323394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:02:38.324591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-07b76ae8-3f86-4d28-90b0-380b94c9cc5e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1795 microversion: 2.20 time: 0.153449 Jun 27 15:02:38.325178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 689/939] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:02:38 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1795 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:03:15.065007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-346bd438-0693-4b00-a321-2bab08c0c606 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc83b666-9d20-47cd-ab45-3b85e30edac6"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:15.065978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-346bd438-0693-4b00-a321-2bab08c0c606 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:15.068337 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=51 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:15.068991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=8 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:15.073787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-346bd438-0693-4b00-a321-2bab08c0c606 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:15.074358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-346bd438-0693-4b00-a321-2bab08c0c606 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:15.075118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-346bd438-0693-4b00-a321-2bab08c0c606 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:15.075556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-346bd438-0693-4b00-a321-2bab08c0c606 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:15.784453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-346bd438-0693-4b00-a321-2bab08c0c606 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723491 Jun 27 15:03:15.785130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 690/940] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:03:15 2022] POST /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:03:16.736119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5f49f0a4-d148-40be-b7bf-6750939ca9ab tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:16.736815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5f49f0a4-d148-40be-b7bf-6750939ca9ab tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:16.742858 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f49f0a4-d148-40be-b7bf-6750939ca9ab tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:16.746459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f49f0a4-d148-40be-b7bf-6750939ca9ab tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:16.746459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f49f0a4-d148-40be-b7bf-6750939ca9ab tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:16.746459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f49f0a4-d148-40be-b7bf-6750939ca9ab tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:16.767769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5f49f0a4-d148-40be-b7bf-6750939ca9ab tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164/ips" status: 200 len: 148 microversion: 2.1 time: 0.037035 Jun 27 15:03:16.768326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 691/941] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:03:16 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:03:16.779623 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d702de13-39c0-4732-975e-d5fcda544899"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:16.780730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:16.786407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:16.786845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:16.787583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:16.788021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:16.868447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Invalid volume: volume d702de13-39c0-4732-975e-d5fcda544899 is already attached to instances: 31fe8f1e-a283-4606-bc7f-fc3900da88fc Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: POST /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164/os-volume_attachments HTTP/1.1 Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 74 Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:03:16.870729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {"volumeAttachment": {"volumeId": "d702de13-39c0-4732-975e-d5fcda544899"}} Jun 27 15:03:16.872843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Invalid volume: volume d702de13-39c0-4732-975e-d5fcda544899 is already attached to instances: 31fe8f1e-a283-4606-bc7f-fc3900da88fc Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'server_id': 'bdc6fa5c-6fa8-4071-a3c0-b52e14b64164', 'body': {'volumeAttachment': {'volumeId': 'd702de13-39c0-4732-975e-d5fcda544899'}}} Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d702de13-39c0-4732-975e-d5fcda544899 is already attached to instances: 31fe8f1e-a283-4606-bc7f-fc3900da88fc Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:16.873679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d702de13-39c0-4732-975e-d5fcda544899 is already attached to instances: 31fe8f1e-a283-4606-bc7f-fc3900da88fc Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:16.875034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:03:16.876358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:03:16.876358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:03:16.876358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:03:16.876358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d702de13-39c0-4732-975e-d5fcda544899 is already attached to instances: 31fe8f1e-a283-4606-bc7f-fc3900da88fc Jun 27 15:03:16.876358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:16.876358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 400 to user: Invalid volume: volume d702de13-39c0-4732-975e-d5fcda544899 is already attached to instances: 31fe8f1e-a283-4606-bc7f-fc3900da88fc {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:03:16.876358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0600e58e-963d-4230-b653-c9163c04147e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096167 Jun 27 15:03:16.876358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 692/942] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:03:16 2022] POST /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:03:16.881735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e1a82245-15b2-4fdc-9806-2a6108236e8b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:16.885260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e1a82245-15b2-4fdc-9806-2a6108236e8b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:16.889042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1a82245-15b2-4fdc-9806-2a6108236e8b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:16.889486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1a82245-15b2-4fdc-9806-2a6108236e8b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:16.890256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1a82245-15b2-4fdc-9806-2a6108236e8b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:16.890685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1a82245-15b2-4fdc-9806-2a6108236e8b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:16.915084 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e1a82245-15b2-4fdc-9806-2a6108236e8b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:03:17.261404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e1a82245-15b2-4fdc-9806-2a6108236e8b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 204 len: 0 microversion: 2.1 time: 0.382996 Jun 27 15:03:17.261929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 693/943] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:03:16 2022] DELETE /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:03:17.270328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c3210b28-e616-45be-9964-40ee85b7bea1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:17.271013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c3210b28-e616-45be-9964-40ee85b7bea1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:17.276857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c3210b28-e616-45be-9964-40ee85b7bea1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:17.277303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c3210b28-e616-45be-9964-40ee85b7bea1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:17.278056 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c3210b28-e616-45be-9964-40ee85b7bea1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:17.279149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c3210b28-e616-45be-9964-40ee85b7bea1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:17.413296 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c3210b28-e616-45be-9964-40ee85b7bea1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:17.421609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c3210b28-e616-45be-9964-40ee85b7bea1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1681 microversion: 2.1 time: 0.155317 Jun 27 15:03:17.422169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 694/944] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:17 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:18.438985 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-eff74b2d-ec1a-47c3-87de-fdc2975dc487 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:18.439718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-eff74b2d-ec1a-47c3-87de-fdc2975dc487 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:18.446153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eff74b2d-ec1a-47c3-87de-fdc2975dc487 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:18.446598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eff74b2d-ec1a-47c3-87de-fdc2975dc487 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:18.447349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eff74b2d-ec1a-47c3-87de-fdc2975dc487 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:18.447777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eff74b2d-ec1a-47c3-87de-fdc2975dc487 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:18.576733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-eff74b2d-ec1a-47c3-87de-fdc2975dc487 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:18.584164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-eff74b2d-ec1a-47c3-87de-fdc2975dc487 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1681 microversion: 2.1 time: 0.150001 Jun 27 15:03:18.584769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 695/945] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:18 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:19.111136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a2be66fa-c7c6-4117-9d9a-ea36a1c351fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:19.111665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a2be66fa-c7c6-4117-9d9a-ea36a1c351fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:19.117909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2be66fa-c7c6-4117-9d9a-ea36a1c351fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:19.118354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2be66fa-c7c6-4117-9d9a-ea36a1c351fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:19.119109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2be66fa-c7c6-4117-9d9a-ea36a1c351fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:19.119538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2be66fa-c7c6-4117-9d9a-ea36a1c351fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:19.141736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-a2be66fa-c7c6-4117-9d9a-ea36a1c351fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lazy-loading 'flavor' on Instance uuid e08c8875-88c6-490f-a2a7-b0332d129e3d {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:03:19.441240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a2be66fa-c7c6-4117-9d9a-ea36a1c351fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "POST /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d/action" status: 202 len: 0 microversion: 2.1 time: 0.334594 Jun 27 15:03:19.441947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 696/946] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:03:19 2022] POST /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:03:19.453370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7055e5d1-1c1a-4374-bd23-d9659838620c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:19.454066 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7055e5d1-1c1a-4374-bd23-d9659838620c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:19.460281 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7055e5d1-1c1a-4374-bd23-d9659838620c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:19.460774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7055e5d1-1c1a-4374-bd23-d9659838620c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:19.461546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7055e5d1-1c1a-4374-bd23-d9659838620c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:19.461978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7055e5d1-1c1a-4374-bd23-d9659838620c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:19.602213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7055e5d1-1c1a-4374-bd23-d9659838620c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:19.610454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7055e5d1-1c1a-4374-bd23-d9659838620c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.164239 Jun 27 15:03:19.611018 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 697/947] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:19 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:19.615350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ddd36ae0-517f-4e67-a612-c77dd6f3a213 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:19.615950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ddd36ae0-517f-4e67-a612-c77dd6f3a213 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:19.621897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ddd36ae0-517f-4e67-a612-c77dd6f3a213 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:19.622366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ddd36ae0-517f-4e67-a612-c77dd6f3a213 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:19.623128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ddd36ae0-517f-4e67-a612-c77dd6f3a213 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:19.623764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ddd36ae0-517f-4e67-a612-c77dd6f3a213 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:19.754878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ddd36ae0-517f-4e67-a612-c77dd6f3a213 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:19.762288 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ddd36ae0-517f-4e67-a612-c77dd6f3a213 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1681 microversion: 2.1 time: 0.150317 Jun 27 15:03:19.762853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 698/948] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:19 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:20.378075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-53e8ce44-54df-4497-9b7e-a08378e0b47a req-6e3e63a3-4c79-4be7-aac1-31434aa286f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc6fa5c-6fa8-4071-a3c0-b52e14b64164", "name": "network-vif-deleted", "tag": "f1cf490b-64aa-49c5-a8ae-c54863aae7cc"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:20.385986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-53e8ce44-54df-4497-9b7e-a08378e0b47a req-6e3e63a3-4c79-4be7-aac1-31434aa286f3 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:20.387414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-53e8ce44-54df-4497-9b7e-a08378e0b47a req-6e3e63a3-4c79-4be7-aac1-31434aa286f3 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:20.399065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-53e8ce44-54df-4497-9b7e-a08378e0b47a req-6e3e63a3-4c79-4be7-aac1-31434aa286f3 service nova] Creating event network-vif-deleted:f1cf490b-64aa-49c5-a8ae-c54863aae7cc for instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 on hv-cinder-79760 Jun 27 15:03:20.404239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-53e8ce44-54df-4497-9b7e-a08378e0b47a req-6e3e63a3-4c79-4be7-aac1-31434aa286f3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030632 Jun 27 15:03:20.405181 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 699/949] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:03:20.629596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-79801bba-66f1-4150-bd50-bf88cd69e5f5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:20.630221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-79801bba-66f1-4150-bd50-bf88cd69e5f5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:20.637528 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79801bba-66f1-4150-bd50-bf88cd69e5f5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:20.637977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79801bba-66f1-4150-bd50-bf88cd69e5f5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:20.638738 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79801bba-66f1-4150-bd50-bf88cd69e5f5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:20.639261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79801bba-66f1-4150-bd50-bf88cd69e5f5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:20.781588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-79801bba-66f1-4150-bd50-bf88cd69e5f5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:20.790944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-79801bba-66f1-4150-bd50-bf88cd69e5f5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.166841 Jun 27 15:03:20.801919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 700/950] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:20 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:20.801919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:20.801919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:20.804248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:20.804735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:20.805505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:20.805941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:20.838765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:20.839219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:20.839675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lazy-loading 'fault' on Instance uuid bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:03:20.888725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:20.896594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-82995489-75cc-4f1d-915c-818228d47698 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 200 len: 1332 microversion: 2.1 time: 0.104014 Jun 27 15:03:20.900699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 701/951] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:20 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:21.809583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-34eec9ec-bc74-47fe-8753-e76ae9ce0d11 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:21.810218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-34eec9ec-bc74-47fe-8753-e76ae9ce0d11 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:21.817607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-34eec9ec-bc74-47fe-8753-e76ae9ce0d11 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:21.818059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-34eec9ec-bc74-47fe-8753-e76ae9ce0d11 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:21.818814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-34eec9ec-bc74-47fe-8753-e76ae9ce0d11 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:21.819249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-34eec9ec-bc74-47fe-8753-e76ae9ce0d11 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:21.823288 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:21.952077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-34eec9ec-bc74-47fe-8753-e76ae9ce0d11 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:21.959565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-34eec9ec-bc74-47fe-8753-e76ae9ce0d11 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.154263 Jun 27 15:03:21.960114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 702/952] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:21 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:21.965112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:21.965707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:21.971375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:21.971817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:21.972565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:21.973013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:21.986617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 HTTP/1.1 Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:03:21.988249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:03:21.989735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'bdc6fa5c-6fa8-4071-a3c0-b52e14b64164'} Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:03:21.990568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:03:21.991826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:21.992997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:03:21.992997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-90278e9e-07d8-42a7-aa08-9e5af7022d6b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 404 len: 111 microversion: 2.1 time: 0.028586 Jun 27 15:03:21.992997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 703/953] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:21 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:03:21.997932 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5eb84432-1e76-4a6d-8109-59753762575c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '.version_select at 0x7f13f96c2f70>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:22.084149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5eb84432-1e76-4a6d-8109-59753762575c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771443822" status: 202 len: 0 microversion: 2.1 time: 0.089454 Jun 27 15:03:22.084863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 704/954] 10.222.0.44 () {58 vars in 1220 bytes} [Mon Jun 27 15:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771443822 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:03:22.977292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-19e43ddf-e367-48ce-8a79-87eeed6a5675 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:22.977991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-19e43ddf-e367-48ce-8a79-87eeed6a5675 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:22.987100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19e43ddf-e367-48ce-8a79-87eeed6a5675 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:22.990206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19e43ddf-e367-48ce-8a79-87eeed6a5675 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:22.990206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19e43ddf-e367-48ce-8a79-87eeed6a5675 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:22.990206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19e43ddf-e367-48ce-8a79-87eeed6a5675 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:23.237586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-19e43ddf-e367-48ce-8a79-87eeed6a5675 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:23.245600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-19e43ddf-e367-48ce-8a79-87eeed6a5675 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.272752 Jun 27 15:03:23.246507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 705/955] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:22 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:23.278326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fb86c335-7623-4498-8677-30925995d028 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:23.278811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fb86c335-7623-4498-8677-30925995d028 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:23.285297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb86c335-7623-4498-8677-30925995d028 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:23.285739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb86c335-7623-4498-8677-30925995d028 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:23.286527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb86c335-7623-4498-8677-30925995d028 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:23.286952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb86c335-7623-4498-8677-30925995d028 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:23.367764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-fb86c335-7623-4498-8677-30925995d028 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lazy-loading 'services' on Instance uuid 31fe8f1e-a283-4606-bc7f-fc3900da88fc {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:03:23.615355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fb86c335-7623-4498-8677-30925995d028 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments/d702de13-39c0-4732-975e-d5fcda544899" status: 202 len: 0 microversion: 2.1 time: 0.340840 Jun 27 15:03:23.615981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 706/956] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:03:23 2022] DELETE /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments/d702de13-39c0-4732-975e-d5fcda544899 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:03:23.624634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a29c2010-4732-44f5-8a62-9ad25d9d1eed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:23.625788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a29c2010-4732-44f5-8a62-9ad25d9d1eed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:23.632074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a29c2010-4732-44f5-8a62-9ad25d9d1eed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:23.632541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a29c2010-4732-44f5-8a62-9ad25d9d1eed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:23.633301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a29c2010-4732-44f5-8a62-9ad25d9d1eed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:23.633733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a29c2010-4732-44f5-8a62-9ad25d9d1eed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:23.664756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a29c2010-4732-44f5-8a62-9ad25d9d1eed tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Jun 27 15:03:23.665328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 707/957] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:03:23 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:03:23.962106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3100b721-d68a-49e7-a43c-40bcef92677e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:23.963090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3100b721-d68a-49e7-a43c-40bcef92677e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:23.969282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3100b721-d68a-49e7-a43c-40bcef92677e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:23.969737 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3100b721-d68a-49e7-a43c-40bcef92677e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:23.970531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3100b721-d68a-49e7-a43c-40bcef92677e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:23.970965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3100b721-d68a-49e7-a43c-40bcef92677e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:24.202224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3100b721-d68a-49e7-a43c-40bcef92677e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "POST /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/action" status: 202 len: 0 microversion: 2.1 time: 0.243689 Jun 27 15:03:24.202902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 708/958] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:03:23 2022] POST /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:03:24.211205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-02ec6314-5024-4ce2-bf3e-3397249e937e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:24.211890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-02ec6314-5024-4ce2-bf3e-3397249e937e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:24.217981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02ec6314-5024-4ce2-bf3e-3397249e937e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:24.218418 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02ec6314-5024-4ce2-bf3e-3397249e937e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:24.219204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02ec6314-5024-4ce2-bf3e-3397249e937e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:24.221613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-02ec6314-5024-4ce2-bf3e-3397249e937e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:24.379478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-02ec6314-5024-4ce2-bf3e-3397249e937e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:24.388005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-02ec6314-5024-4ce2-bf3e-3397249e937e tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1753 microversion: 2.1 time: 0.180742 Jun 27 15:03:24.388806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 709/959] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:24 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:24.393511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-16a67fde-10d8-4c6b-97b7-477b5dc370f9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:24.394133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-16a67fde-10d8-4c6b-97b7-477b5dc370f9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:24.400013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-16a67fde-10d8-4c6b-97b7-477b5dc370f9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:24.400519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-16a67fde-10d8-4c6b-97b7-477b5dc370f9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:24.401317 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-16a67fde-10d8-4c6b-97b7-477b5dc370f9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:24.401744 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-16a67fde-10d8-4c6b-97b7-477b5dc370f9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:24.540812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-16a67fde-10d8-4c6b-97b7-477b5dc370f9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:24.549221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-16a67fde-10d8-4c6b-97b7-477b5dc370f9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.159369 Jun 27 15:03:24.551447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 710/960] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:24 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:24.554753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7570e78d-6e16-4acc-ba75-42ba71bf61c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:24.555733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7570e78d-6e16-4acc-ba75-42ba71bf61c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:24.561971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7570e78d-6e16-4acc-ba75-42ba71bf61c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:24.562466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7570e78d-6e16-4acc-ba75-42ba71bf61c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:24.563230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7570e78d-6e16-4acc-ba75-42ba71bf61c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:24.563655 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7570e78d-6e16-4acc-ba75-42ba71bf61c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:24.587079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-7570e78d-6e16-4acc-ba75-42ba71bf61c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lazy-loading 'flavor' on Instance uuid 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:03:24.958349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7570e78d-6e16-4acc-ba75-42ba71bf61c6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/action" status: 200 len: 32 microversion: 2.1 time: 0.407116 Jun 27 15:03:24.958958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 711/961] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:03:24 2022] POST /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/action => generated 32 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:03:24.964602 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c2ee51b3-a5ea-4c56-b7c6-50bcb7d14c7a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:24.965621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c2ee51b3-a5ea-4c56-b7c6-50bcb7d14c7a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:24.973605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c2ee51b3-a5ea-4c56-b7c6-50bcb7d14c7a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:24.974028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c2ee51b3-a5ea-4c56-b7c6-50bcb7d14c7a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:24.974796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c2ee51b3-a5ea-4c56-b7c6-50bcb7d14c7a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:24.975230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c2ee51b3-a5ea-4c56-b7c6-50bcb7d14c7a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:25.007729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c2ee51b3-a5ea-4c56-b7c6-50bcb7d14c7a tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047467 Jun 27 15:03:25.008325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 712/962] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:03:24 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:03:25.012839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e657a351-4af1-4436-b73a-fce0604aca13 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:25.013447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e657a351-4af1-4436-b73a-fce0604aca13 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:25.020061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e657a351-4af1-4436-b73a-fce0604aca13 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:25.020514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e657a351-4af1-4436-b73a-fce0604aca13 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:25.021325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e657a351-4af1-4436-b73a-fce0604aca13 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:25.021870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e657a351-4af1-4436-b73a-fce0604aca13 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:25.167351 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e657a351-4af1-4436-b73a-fce0604aca13 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:25.174672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e657a351-4af1-4436-b73a-fce0604aca13 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.165271 Jun 27 15:03:25.175251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 713/963] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:25 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:25.405198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d47c2d27-668d-403f-b878-2d47699b8cd6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:25.405825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d47c2d27-668d-403f-b878-2d47699b8cd6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:25.411766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d47c2d27-668d-403f-b878-2d47699b8cd6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:25.412205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d47c2d27-668d-403f-b878-2d47699b8cd6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:25.412988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d47c2d27-668d-403f-b878-2d47699b8cd6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:25.413415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d47c2d27-668d-403f-b878-2d47699b8cd6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:25.554387 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d47c2d27-668d-403f-b878-2d47699b8cd6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:25.563615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d47c2d27-668d-403f-b878-2d47699b8cd6 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.162024 Jun 27 15:03:25.564189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 714/964] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:25 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:25.568616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b55f83f0-61c5-4246-ba51-1c983cef315c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:25.569247 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b55f83f0-61c5-4246-ba51-1c983cef315c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:25.575037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b55f83f0-61c5-4246-ba51-1c983cef315c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:25.575478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b55f83f0-61c5-4246-ba51-1c983cef315c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:25.576216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b55f83f0-61c5-4246-ba51-1c983cef315c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:25.576673 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b55f83f0-61c5-4246-ba51-1c983cef315c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:25.711612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b55f83f0-61c5-4246-ba51-1c983cef315c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:25.719303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b55f83f0-61c5-4246-ba51-1c983cef315c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.154095 Jun 27 15:03:25.720087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 715/965] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:25 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:26.019615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ea6e6798-e9c9-4ad8-ad11-f9aa34ceb3f4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:26.020507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ea6e6798-e9c9-4ad8-ad11-f9aa34ceb3f4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:26.026861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea6e6798-e9c9-4ad8-ad11-f9aa34ceb3f4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.027304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea6e6798-e9c9-4ad8-ad11-f9aa34ceb3f4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.028055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea6e6798-e9c9-4ad8-ad11-f9aa34ceb3f4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.028486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ea6e6798-e9c9-4ad8-ad11-f9aa34ceb3f4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.054136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:26.058119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ea6e6798-e9c9-4ad8-ad11-f9aa34ceb3f4 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042697 Jun 27 15:03:26.062549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 716/966] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:03:26 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:03:26.120523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-94c70781-0921-4b21-acd4-4b432e6865dc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:26.121038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-94c70781-0921-4b21-acd4-4b432e6865dc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:26.127692 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94c70781-0921-4b21-acd4-4b432e6865dc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.128130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94c70781-0921-4b21-acd4-4b432e6865dc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.128910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94c70781-0921-4b21-acd4-4b432e6865dc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.129339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94c70781-0921-4b21-acd4-4b432e6865dc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.153108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-94c70781-0921-4b21-acd4-4b432e6865dc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:03:26.409815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-94c70781-0921-4b21-acd4-4b432e6865dc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 204 len: 0 microversion: 2.1 time: 0.292910 Jun 27 15:03:26.410511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 717/967] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:03:26 2022] DELETE /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:03:26.415338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c9a0b787-3ff1-45e5-9cb3-43232aa30008 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:26.416018 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c9a0b787-3ff1-45e5-9cb3-43232aa30008 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:26.421792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9a0b787-3ff1-45e5-9cb3-43232aa30008 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.422235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9a0b787-3ff1-45e5-9cb3-43232aa30008 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.422981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9a0b787-3ff1-45e5-9cb3-43232aa30008 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.423401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c9a0b787-3ff1-45e5-9cb3-43232aa30008 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.553356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c9a0b787-3ff1-45e5-9cb3-43232aa30008 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:26.561608 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c9a0b787-3ff1-45e5-9cb3-43232aa30008 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.150067 Jun 27 15:03:26.562169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 718/968] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:26 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:26.566486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-12219f91-1eb2-4761-acaa-80848c03affa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:26.567067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-12219f91-1eb2-4761-acaa-80848c03affa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:26.572661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-12219f91-1eb2-4761-acaa-80848c03affa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.578448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-12219f91-1eb2-4761-acaa-80848c03affa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.578448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-12219f91-1eb2-4761-acaa-80848c03affa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.578448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-12219f91-1eb2-4761-acaa-80848c03affa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.705630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-12219f91-1eb2-4761-acaa-80848c03affa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:26.712972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-12219f91-1eb2-4761-acaa-80848c03affa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1681 microversion: 2.1 time: 0.149843 Jun 27 15:03:26.713529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 719/969] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:26 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:26.721478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-73fa13f4-4efe-443b-8c07-6c27d02f0d41 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:26.721478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-73fa13f4-4efe-443b-8c07-6c27d02f0d41 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:26.724797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73fa13f4-4efe-443b-8c07-6c27d02f0d41 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.725237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73fa13f4-4efe-443b-8c07-6c27d02f0d41 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.725980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73fa13f4-4efe-443b-8c07-6c27d02f0d41 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.726410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73fa13f4-4efe-443b-8c07-6c27d02f0d41 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.866407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-73fa13f4-4efe-443b-8c07-6c27d02f0d41 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:26.874248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-73fa13f4-4efe-443b-8c07-6c27d02f0d41 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.159793 Jun 27 15:03:26.875366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 720/970] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:26 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:26.879683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-606f9c8e-59c7-45e9-bc66-e81d019d923a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:26.880294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-606f9c8e-59c7-45e9-bc66-e81d019d923a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:26.885754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-606f9c8e-59c7-45e9-bc66-e81d019d923a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.886194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-606f9c8e-59c7-45e9-bc66-e81d019d923a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:26.886930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-606f9c8e-59c7-45e9-bc66-e81d019d923a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:26.887349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-606f9c8e-59c7-45e9-bc66-e81d019d923a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:27.017717 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-606f9c8e-59c7-45e9-bc66-e81d019d923a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:27.025671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-606f9c8e-59c7-45e9-bc66-e81d019d923a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.149377 Jun 27 15:03:27.026238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 721/971] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:26 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:27.578787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6f980a09-7bb8-4696-8274-94b98a994308 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:27.579468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6f980a09-7bb8-4696-8274-94b98a994308 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:27.585431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6f980a09-7bb8-4696-8274-94b98a994308 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:27.585877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6f980a09-7bb8-4696-8274-94b98a994308 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:27.586632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6f980a09-7bb8-4696-8274-94b98a994308 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:27.587065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6f980a09-7bb8-4696-8274-94b98a994308 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:27.722925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6f980a09-7bb8-4696-8274-94b98a994308 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:27.731213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6f980a09-7bb8-4696-8274-94b98a994308 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.156327 Jun 27 15:03:27.731986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 722/972] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:27 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:27.736987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-39a23ec4-3ce3-42a7-8221-c6f8fd64ca55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:27.737587 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-39a23ec4-3ce3-42a7-8221-c6f8fd64ca55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:27.743507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39a23ec4-3ce3-42a7-8221-c6f8fd64ca55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:27.743948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39a23ec4-3ce3-42a7-8221-c6f8fd64ca55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:27.744786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39a23ec4-3ce3-42a7-8221-c6f8fd64ca55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:27.745219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-39a23ec4-3ce3-42a7-8221-c6f8fd64ca55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:27.875411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-39a23ec4-3ce3-42a7-8221-c6f8fd64ca55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:27.883274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-39a23ec4-3ce3-42a7-8221-c6f8fd64ca55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1681 microversion: 2.1 time: 0.150419 Jun 27 15:03:27.883846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 723/973] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:27 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:27.893190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fffbd795-596d-485f-91dd-a103bed1e6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:27.893929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fffbd795-596d-485f-91dd-a103bed1e6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:27.899907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fffbd795-596d-485f-91dd-a103bed1e6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:27.900354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fffbd795-596d-485f-91dd-a103bed1e6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:27.901138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fffbd795-596d-485f-91dd-a103bed1e6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:27.901566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fffbd795-596d-485f-91dd-a103bed1e6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:28.052719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fffbd795-596d-485f-91dd-a103bed1e6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:28.058635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fffbd795-596d-485f-91dd-a103bed1e6bc tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.171113 Jun 27 15:03:28.059453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 724/974] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:27 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:28.063923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9c94cad2-744c-4024-bd86-e2aad96bd504 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:28.064515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9c94cad2-744c-4024-bd86-e2aad96bd504 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:28.070367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c94cad2-744c-4024-bd86-e2aad96bd504 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:28.070861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c94cad2-744c-4024-bd86-e2aad96bd504 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:28.071547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c94cad2-744c-4024-bd86-e2aad96bd504 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:28.071979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c94cad2-744c-4024-bd86-e2aad96bd504 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:28.212337 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9c94cad2-744c-4024-bd86-e2aad96bd504 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:28.220970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9c94cad2-744c-4024-bd86-e2aad96bd504 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.160449 Jun 27 15:03:28.221589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 725/975] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:28 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:28.652021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-47660d4f-21ef-481d-a515-b22c0ff892f6 req-f68ac509-56f8-4fba-b725-6190a8e394b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fe8f1e-a283-4606-bc7f-fc3900da88fc", "name": "network-vif-deleted", "tag": "4f50000a-d5a7-4cf4-a7ef-66f62c841dfe"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:28.660608 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-47660d4f-21ef-481d-a515-b22c0ff892f6 req-f68ac509-56f8-4fba-b725-6190a8e394b4 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:28.661069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-47660d4f-21ef-481d-a515-b22c0ff892f6 req-f68ac509-56f8-4fba-b725-6190a8e394b4 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:28.673671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-47660d4f-21ef-481d-a515-b22c0ff892f6 req-f68ac509-56f8-4fba-b725-6190a8e394b4 service nova] Creating event network-vif-deleted:4f50000a-d5a7-4cf4-a7ef-66f62c841dfe for instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc on hv-cinder-79760 Jun 27 15:03:28.678631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-47660d4f-21ef-481d-a515-b22c0ff892f6 req-f68ac509-56f8-4fba-b725-6190a8e394b4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030233 Jun 27 15:03:28.679259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 726/976] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:03:28.750815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-dad28f50-8b71-4633-ab02-73d3fcd1326e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:28.751447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-dad28f50-8b71-4633-ab02-73d3fcd1326e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:28.758638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dad28f50-8b71-4633-ab02-73d3fcd1326e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:28.758638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dad28f50-8b71-4633-ab02-73d3fcd1326e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:28.759362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dad28f50-8b71-4633-ab02-73d3fcd1326e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:28.759793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dad28f50-8b71-4633-ab02-73d3fcd1326e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:28.898588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-dad28f50-8b71-4633-ab02-73d3fcd1326e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:28.908161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-dad28f50-8b71-4633-ab02-73d3fcd1326e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.162267 Jun 27 15:03:28.908856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 727/977] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:28 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:28.915697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:28.915697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:28.919948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:28.920491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:28.921323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:28.922370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:28.957173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:28.957729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:28.958241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lazy-loading 'fault' on Instance uuid 31fe8f1e-a283-4606-bc7f-fc3900da88fc {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:03:29.003779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:29.011794 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3588a97b-ce33-4496-b25a-3ca8f3aeaf9e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 200 len: 1331 microversion: 2.1 time: 0.101782 Jun 27 15:03:29.012366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 728/978] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:28 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:29.076407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b306cf44-49f7-4c3e-8c13-b24af2ab341c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:29.077067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b306cf44-49f7-4c3e-8c13-b24af2ab341c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:29.083699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b306cf44-49f7-4c3e-8c13-b24af2ab341c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:29.084147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b306cf44-49f7-4c3e-8c13-b24af2ab341c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:29.084941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b306cf44-49f7-4c3e-8c13-b24af2ab341c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:29.085374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b306cf44-49f7-4c3e-8c13-b24af2ab341c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:29.242803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b306cf44-49f7-4c3e-8c13-b24af2ab341c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:29.250785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b306cf44-49f7-4c3e-8c13-b24af2ab341c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.178247 Jun 27 15:03:29.251437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 729/979] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:29 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:29.264529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-634d7d86-abcd-4723-819a-50d1a09de208 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:29.271026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-634d7d86-abcd-4723-819a-50d1a09de208 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:29.271026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:29.271649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-634d7d86-abcd-4723-819a-50d1a09de208 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:29.272092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-634d7d86-abcd-4723-819a-50d1a09de208 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:29.272885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-634d7d86-abcd-4723-819a-50d1a09de208 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:29.273319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-634d7d86-abcd-4723-819a-50d1a09de208 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:29.419079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-634d7d86-abcd-4723-819a-50d1a09de208 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:29.431318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-634d7d86-abcd-4723-819a-50d1a09de208 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.170258 Jun 27 15:03:29.431902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 730/980] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:29 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:29.925017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-068b496f-46b5-48e1-9a11-6403328ae83a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:29.925689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-068b496f-46b5-48e1-9a11-6403328ae83a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:29.931817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-068b496f-46b5-48e1-9a11-6403328ae83a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:29.932334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-068b496f-46b5-48e1-9a11-6403328ae83a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:29.933193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-068b496f-46b5-48e1-9a11-6403328ae83a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:29.933953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-068b496f-46b5-48e1-9a11-6403328ae83a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:30.070868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-068b496f-46b5-48e1-9a11-6403328ae83a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:30.079711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-068b496f-46b5-48e1-9a11-6403328ae83a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.158701 Jun 27 15:03:30.080290 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 731/981] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:29 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:30.088105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:30.088105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:30.094501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:30.094945 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:30.095714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:30.096144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:30.100281 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:30.110762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc HTTP/1.1 Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:03:30.115183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:03:30.116806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '31fe8f1e-a283-4606-bc7f-fc3900da88fc'} Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:03:30.117972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:03:30.119421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:30.120756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:03:30.120756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-88d9f895-e094-4219-a13f-a52cfe4c7854 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 404 len: 111 microversion: 2.1 time: 0.032555 Jun 27 15:03:30.120756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 732/982] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:30 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:03:30.122532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-be4b9a54-c1e4-4b13-a569-ab84a00314dd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '.version_select at 0x7f13f96fc4c0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:30.193897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-be4b9a54-c1e4-4b13-a569-ab84a00314dd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653289847" status: 202 len: 0 microversion: 2.1 time: 0.074898 Jun 27 15:03:30.194483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 733/983] 10.222.0.44 () {58 vars in 1217 bytes} [Mon Jun 27 15:03:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653289847 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:03:30.271223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e137c867-7143-47e2-88d4-889e49a6fa46 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:30.272442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e137c867-7143-47e2-88d4-889e49a6fa46 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:30.280284 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e137c867-7143-47e2-88d4-889e49a6fa46 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:30.283545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e137c867-7143-47e2-88d4-889e49a6fa46 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:30.283545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e137c867-7143-47e2-88d4-889e49a6fa46 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:30.283545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e137c867-7143-47e2-88d4-889e49a6fa46 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:30.439944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e137c867-7143-47e2-88d4-889e49a6fa46 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:30.456164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e137c867-7143-47e2-88d4-889e49a6fa46 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.192646 Jun 27 15:03:30.463409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 734/984] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:30 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:30.463409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-af8de863-627e-4932-9274-fb0903039c02 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:30.463409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-af8de863-627e-4932-9274-fb0903039c02 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:30.474639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af8de863-627e-4932-9274-fb0903039c02 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:30.475097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af8de863-627e-4932-9274-fb0903039c02 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:30.475961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af8de863-627e-4932-9274-fb0903039c02 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:30.476566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af8de863-627e-4932-9274-fb0903039c02 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:30.617452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-af8de863-627e-4932-9274-fb0903039c02 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:30.624999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-af8de863-627e-4932-9274-fb0903039c02 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.166586 Jun 27 15:03:30.625699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 735/985] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:30 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:31.058290 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-200c69ce-9418-4383-a721-2364198fba33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: .version_select at 0x7f13f96ca940>, body: {"keypair": {"name": "tempest-keypair-1362732370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdZGNc/kEoIaIEI/5uIcJHfZv8JNY/rdQpYebJ8Dhi9R38EwMq8+fwN3K0BcTAzozfGwgSmjBI4K34sFnZNbVPruehx37J9In4FczGW8iTixg4qTuhsuiTVknflWlIdpQ=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:31.072192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-200c69ce-9418-4383-a721-2364198fba33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for project 3d96ee908883411d9838f850ee7dd66b. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:03:31.075937 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-200c69ce-9418-4383-a721-2364198fba33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for user d93abd4361d240919ec85cf4b92347fb and project 3d96ee908883411d9838f850ee7dd66b. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:03:31.154410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-200c69ce-9418-4383-a721-2364198fba33 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099983 Jun 27 15:03:31.155015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 736/986] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 15:03:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:03:31.160337 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-020db5d7-1697-4d45-8231-00592fe8fab6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:31.161011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-020db5d7-1697-4d45-8231-00592fe8fab6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:31.167302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-020db5d7-1697-4d45-8231-00592fe8fab6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:31.167780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-020db5d7-1697-4d45-8231-00592fe8fab6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:31.168545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-020db5d7-1697-4d45-8231-00592fe8fab6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:31.169012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-020db5d7-1697-4d45-8231-00592fe8fab6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:31.328820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-020db5d7-1697-4d45-8231-00592fe8fab6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:31.336844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-020db5d7-1697-4d45-8231-00592fe8fab6 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.180831 Jun 27 15:03:31.337416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 737/987] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:31 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:31.474021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b98fd470-1aa1-4b43-b126-2bd7bd41a6b5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:31.474554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b98fd470-1aa1-4b43-b126-2bd7bd41a6b5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:31.480569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b98fd470-1aa1-4b43-b126-2bd7bd41a6b5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:31.481060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b98fd470-1aa1-4b43-b126-2bd7bd41a6b5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:31.481811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b98fd470-1aa1-4b43-b126-2bd7bd41a6b5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:31.482351 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b98fd470-1aa1-4b43-b126-2bd7bd41a6b5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:31.668224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b98fd470-1aa1-4b43-b126-2bd7bd41a6b5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:31.678450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b98fd470-1aa1-4b43-b126-2bd7bd41a6b5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.208287 Jun 27 15:03:31.679196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 738/988] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:31 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:31.683579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-80c4c69e-3ff8-4117-8fcd-baae55783ae9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:31.684442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-80c4c69e-3ff8-4117-8fcd-baae55783ae9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:31.691348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80c4c69e-3ff8-4117-8fcd-baae55783ae9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:31.691923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80c4c69e-3ff8-4117-8fcd-baae55783ae9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:31.692713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80c4c69e-3ff8-4117-8fcd-baae55783ae9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:31.693155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80c4c69e-3ff8-4117-8fcd-baae55783ae9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:31.847120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-80c4c69e-3ff8-4117-8fcd-baae55783ae9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:31.855066 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-80c4c69e-3ff8-4117-8fcd-baae55783ae9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.175059 Jun 27 15:03:31.855632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 739/989] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:31 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:32.353671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5bd4e893-a725-4efb-b77e-4a076163b41d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:32.354271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5bd4e893-a725-4efb-b77e-4a076163b41d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:32.360770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5bd4e893-a725-4efb-b77e-4a076163b41d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:32.361224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5bd4e893-a725-4efb-b77e-4a076163b41d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:32.362000 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5bd4e893-a725-4efb-b77e-4a076163b41d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:32.362423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5bd4e893-a725-4efb-b77e-4a076163b41d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:32.570944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5bd4e893-a725-4efb-b77e-4a076163b41d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:32.581155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5bd4e893-a725-4efb-b77e-4a076163b41d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.231172 Jun 27 15:03:32.581818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 740/990] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:32 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:32.703482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5d453ee5-4379-4320-a6bc-967180774290 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:32.708953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5d453ee5-4379-4320-a6bc-967180774290 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:32.710574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d453ee5-4379-4320-a6bc-967180774290 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:32.711022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d453ee5-4379-4320-a6bc-967180774290 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:32.711815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d453ee5-4379-4320-a6bc-967180774290 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:32.712219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d453ee5-4379-4320-a6bc-967180774290 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:32.917693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5d453ee5-4379-4320-a6bc-967180774290 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:32.926066 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5d453ee5-4379-4320-a6bc-967180774290 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.227114 Jun 27 15:03:32.926910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 741/991] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:32 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:32.931827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5e73c00b-f329-493e-9e0f-49119d5cccde tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:32.932637 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5e73c00b-f329-493e-9e0f-49119d5cccde tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:32.939926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5e73c00b-f329-493e-9e0f-49119d5cccde tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:32.940372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5e73c00b-f329-493e-9e0f-49119d5cccde tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:32.941224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5e73c00b-f329-493e-9e0f-49119d5cccde tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:32.947277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5e73c00b-f329-493e-9e0f-49119d5cccde tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:33.196721 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5e73c00b-f329-493e-9e0f-49119d5cccde tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:33.204833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5e73c00b-f329-493e-9e0f-49119d5cccde tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.276469 Jun 27 15:03:33.211639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 742/992] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:32 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:33.599120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b17256ab-e28b-45cd-b79a-21a333347a1a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:33.599762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b17256ab-e28b-45cd-b79a-21a333347a1a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:33.609202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b17256ab-e28b-45cd-b79a-21a333347a1a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:33.609202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b17256ab-e28b-45cd-b79a-21a333347a1a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:33.609202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b17256ab-e28b-45cd-b79a-21a333347a1a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:33.609202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b17256ab-e28b-45cd-b79a-21a333347a1a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:33.747927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b17256ab-e28b-45cd-b79a-21a333347a1a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:33.757458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b17256ab-e28b-45cd-b79a-21a333347a1a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.162310 Jun 27 15:03:33.758052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 743/993] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:33 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:33.814702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-205384875", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a5eed5b-e23d-40b2-b9c3-11f70e365ab5"}], "security_groups": [{"name": "tempest-securitygroup--1925618492"}], "key_name": "tempest-keypair-1362732370", "user_data": "}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:33.912709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] validate_networks() for [('5a5eed5b-e23d-40b2-b9c3-11f70e365ab5', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:03:34.274027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:03:34.274446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:03:34.274913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:03:34.275344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:03:34.275753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:03:34.285135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:34.285575 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:34.286368 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:34.286803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:34.304064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for project 3d96ee908883411d9838f850ee7dd66b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:03:34.307945 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for user d93abd4361d240919ec85cf4b92347fb and project 3d96ee908883411d9838f850ee7dd66b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:03:34.318890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:03:34.321119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:03:34.451956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5af8f12f-210a-4a33-b787-62e7d6a2be2d tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.642017 Jun 27 15:03:34.452581 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 744/994] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:03:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:03:34.457227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-00c094b1-4636-44e6-8320-2eb06b204eb7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:34.458019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-00c094b1-4636-44e6-8320-2eb06b204eb7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:34.467062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00c094b1-4636-44e6-8320-2eb06b204eb7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:34.467570 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00c094b1-4636-44e6-8320-2eb06b204eb7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:34.469193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00c094b1-4636-44e6-8320-2eb06b204eb7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:34.469645 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00c094b1-4636-44e6-8320-2eb06b204eb7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:34.619764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-00c094b1-4636-44e6-8320-2eb06b204eb7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:34.628545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-00c094b1-4636-44e6-8320-2eb06b204eb7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.174843 Jun 27 15:03:34.629318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 745/995] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:34 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:34.633759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ac92da72-e9e4-4c5c-959a-4621a7a9be9a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:34.634389 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ac92da72-e9e4-4c5c-959a-4621a7a9be9a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:34.640087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac92da72-e9e4-4c5c-959a-4621a7a9be9a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:34.640827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac92da72-e9e4-4c5c-959a-4621a7a9be9a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:34.641306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac92da72-e9e4-4c5c-959a-4621a7a9be9a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:34.641741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac92da72-e9e4-4c5c-959a-4621a7a9be9a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:34.771483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ac92da72-e9e4-4c5c-959a-4621a7a9be9a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:34.779087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ac92da72-e9e4-4c5c-959a-4621a7a9be9a tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1508 microversion: 2.1 time: 0.148790 Jun 27 15:03:34.779651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 746/996] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:34 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:34.784001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-96da7c70-951b-4ff6-8bd0-db0796f73432 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:34.784603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-96da7c70-951b-4ff6-8bd0-db0796f73432 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:34.838714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-96da7c70-951b-4ff6-8bd0-db0796f73432 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:34.845641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-96da7c70-951b-4ff6-8bd0-db0796f73432 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1241 microversion: 2.1 time: 0.065034 Jun 27 15:03:34.846295 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 747/997] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:34 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:34.850703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ef490e0e-6cb6-44c5-9270-d2d79deaaf2b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:34.851300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ef490e0e-6cb6-44c5-9270-d2d79deaaf2b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:34.856897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef490e0e-6cb6-44c5-9270-d2d79deaaf2b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:34.861853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef490e0e-6cb6-44c5-9270-d2d79deaaf2b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:34.861853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef490e0e-6cb6-44c5-9270-d2d79deaaf2b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:34.861853 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ef490e0e-6cb6-44c5-9270-d2d79deaaf2b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:34.996060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ef490e0e-6cb6-44c5-9270-d2d79deaaf2b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:35.004294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ef490e0e-6cb6-44c5-9270-d2d79deaaf2b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.156982 Jun 27 15:03:35.004891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 748/998] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:34 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:35.009372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5950b10b-e10a-41c7-ba2f-1573d4a501ad tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:35.011095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5950b10b-e10a-41c7-ba2f-1573d4a501ad tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:35.015763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5950b10b-e10a-41c7-ba2f-1573d4a501ad tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:35.016201 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5950b10b-e10a-41c7-ba2f-1573d4a501ad tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:35.017138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5950b10b-e10a-41c7-ba2f-1573d4a501ad tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:35.017585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5950b10b-e10a-41c7-ba2f-1573d4a501ad tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:35.262669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5950b10b-e10a-41c7-ba2f-1573d4a501ad tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "POST /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d/action" status: 202 len: 0 microversion: 2.1 time: 0.256687 Jun 27 15:03:35.263222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 749/999] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:03:35 2022] POST /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:03:35.271687 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-eab8f5cb-99c0-47bc-ab14-813efe3d01ea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:35.272290 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-eab8f5cb-99c0-47bc-ab14-813efe3d01ea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:35.278863 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eab8f5cb-99c0-47bc-ab14-813efe3d01ea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:35.279647 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eab8f5cb-99c0-47bc-ab14-813efe3d01ea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:35.280054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eab8f5cb-99c0-47bc-ab14-813efe3d01ea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:35.280481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eab8f5cb-99c0-47bc-ab14-813efe3d01ea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:35.423653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-eab8f5cb-99c0-47bc-ab14-813efe3d01ea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:35.431349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-eab8f5cb-99c0-47bc-ab14-813efe3d01ea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1516 microversion: 2.1 time: 0.163687 Jun 27 15:03:35.431921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 750/1000] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:35 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:35.646410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1d1800f0-d9cc-431d-8e7b-49452322644b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:35.651773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1d1800f0-d9cc-431d-8e7b-49452322644b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:35.653388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d1800f0-d9cc-431d-8e7b-49452322644b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:35.653834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d1800f0-d9cc-431d-8e7b-49452322644b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:35.654589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d1800f0-d9cc-431d-8e7b-49452322644b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:35.655016 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1d1800f0-d9cc-431d-8e7b-49452322644b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:35.807971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1d1800f0-d9cc-431d-8e7b-49452322644b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:35.816898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1d1800f0-d9cc-431d-8e7b-49452322644b tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.174291 Jun 27 15:03:35.817476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 751/1001] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:35 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:35.862116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c4643a0b-aeae-4f2f-83bb-d95388e97479 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:35.862711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c4643a0b-aeae-4f2f-83bb-d95388e97479 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:35.868862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4643a0b-aeae-4f2f-83bb-d95388e97479 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:35.869303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4643a0b-aeae-4f2f-83bb-d95388e97479 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:35.876091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4643a0b-aeae-4f2f-83bb-d95388e97479 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:35.876091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4643a0b-aeae-4f2f-83bb-d95388e97479 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:35.876091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:35.932542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c4643a0b-aeae-4f2f-83bb-d95388e97479 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:35.940624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c4643a0b-aeae-4f2f-83bb-d95388e97479 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1293 microversion: 2.1 time: 0.082585 Jun 27 15:03:35.941184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 752/1002] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:35 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:36.022543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f78ab6f7-420b-43a4-9a88-eca753f42171 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:36.023199 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f78ab6f7-420b-43a4-9a88-eca753f42171 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:36.030355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f78ab6f7-420b-43a4-9a88-eca753f42171 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:36.030979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f78ab6f7-420b-43a4-9a88-eca753f42171 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:36.031912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f78ab6f7-420b-43a4-9a88-eca753f42171 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:36.032354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f78ab6f7-420b-43a4-9a88-eca753f42171 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:36.161888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f78ab6f7-420b-43a4-9a88-eca753f42171 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:36.169772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f78ab6f7-420b-43a4-9a88-eca753f42171 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.151546 Jun 27 15:03:36.170335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 753/1003] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:36 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:36.321324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-af9a158a-e722-4af0-a322-9ceadee81977 req-588bd0f1-1d17-4a28-be84-47243250502e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c8875-88c6-490f-a2a7-b0332d129e3d", "name": "network-vif-unplugged", "status": "completed", "tag": "05abf890-aa38-4cf8-b0bb-92c6ba77980d"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:36.330174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-af9a158a-e722-4af0-a322-9ceadee81977 req-588bd0f1-1d17-4a28-be84-47243250502e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:36.330686 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-af9a158a-e722-4af0-a322-9ceadee81977 req-588bd0f1-1d17-4a28-be84-47243250502e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:36.342590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.compute.server_external_events [req-af9a158a-e722-4af0-a322-9ceadee81977 req-588bd0f1-1d17-4a28-be84-47243250502e service nova] Unable to find a host for instance e08c8875-88c6-490f-a2a7-b0332d129e3d. Dropping event network-vif-unplugged {{(pid=129687) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 15:03:36.343460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-af9a158a-e722-4af0-a322-9ceadee81977 req-588bd0f1-1d17-4a28-be84-47243250502e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026305 Jun 27 15:03:36.344033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 754/1004] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 27 15:03:36.448800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a008125b-4069-4f51-bcf6-822ce9b11b2c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:36.449657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a008125b-4069-4f51-bcf6-822ce9b11b2c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:36.456538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a008125b-4069-4f51-bcf6-822ce9b11b2c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:36.457080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a008125b-4069-4f51-bcf6-822ce9b11b2c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:36.461406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a008125b-4069-4f51-bcf6-822ce9b11b2c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:36.461875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a008125b-4069-4f51-bcf6-822ce9b11b2c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:36.602976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a008125b-4069-4f51-bcf6-822ce9b11b2c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:36.614172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a008125b-4069-4f51-bcf6-822ce9b11b2c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1516 microversion: 2.1 time: 0.169247 Jun 27 15:03:36.614786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 755/1005] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:36 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:36.835125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-101332f2-e6ea-498c-b5e3-3e23599411c0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:36.835755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-101332f2-e6ea-498c-b5e3-3e23599411c0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:36.842547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-101332f2-e6ea-498c-b5e3-3e23599411c0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:36.846507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-101332f2-e6ea-498c-b5e3-3e23599411c0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:36.846507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-101332f2-e6ea-498c-b5e3-3e23599411c0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:36.846507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-101332f2-e6ea-498c-b5e3-3e23599411c0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:36.992225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-101332f2-e6ea-498c-b5e3-3e23599411c0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:37.000079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-101332f2-e6ea-498c-b5e3-3e23599411c0 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.169363 Jun 27 15:03:37.000751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 756/1006] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:36 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:37.005308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7b1fd56c-fa48-4fa2-8211-5fa39f8d03ee tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:37.005935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7b1fd56c-fa48-4fa2-8211-5fa39f8d03ee tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:37.012025 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b1fd56c-fa48-4fa2-8211-5fa39f8d03ee tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:37.012470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b1fd56c-fa48-4fa2-8211-5fa39f8d03ee tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:37.013270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b1fd56c-fa48-4fa2-8211-5fa39f8d03ee tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:37.013862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b1fd56c-fa48-4fa2-8211-5fa39f8d03ee tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:37.080708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7b1fd56c-fa48-4fa2-8211-5fa39f8d03ee tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:37.088282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7b1fd56c-fa48-4fa2-8211-5fa39f8d03ee tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1299 microversion: 2.1 time: 0.086267 Jun 27 15:03:37.088913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 757/1007] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:37 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:37.187433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-97af9c3a-b702-4e84-b2fb-d2d3a51d7286 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:37.189328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-97af9c3a-b702-4e84-b2fb-d2d3a51d7286 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:37.195494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97af9c3a-b702-4e84-b2fb-d2d3a51d7286 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:37.199701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97af9c3a-b702-4e84-b2fb-d2d3a51d7286 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:37.199701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97af9c3a-b702-4e84-b2fb-d2d3a51d7286 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:37.199701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97af9c3a-b702-4e84-b2fb-d2d3a51d7286 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:37.329996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-97af9c3a-b702-4e84-b2fb-d2d3a51d7286 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:37.338144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-97af9c3a-b702-4e84-b2fb-d2d3a51d7286 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.154808 Jun 27 15:03:37.338746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 758/1008] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:37 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:37.824035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bff2babc-3d0c-4c1e-8a5d-42963599a2ae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:37.824770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bff2babc-3d0c-4c1e-8a5d-42963599a2ae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:37.831581 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bff2babc-3d0c-4c1e-8a5d-42963599a2ae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:37.832007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bff2babc-3d0c-4c1e-8a5d-42963599a2ae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:37.832871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bff2babc-3d0c-4c1e-8a5d-42963599a2ae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:37.833566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bff2babc-3d0c-4c1e-8a5d-42963599a2ae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:37.970660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bff2babc-3d0c-4c1e-8a5d-42963599a2ae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:37.978683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bff2babc-3d0c-4c1e-8a5d-42963599a2ae tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1518 microversion: 2.1 time: 0.351152 Jun 27 15:03:37.984525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 759/1009] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:37 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1518 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:38.018058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3cddcb34-e718-4455-8de7-972e6c673617 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:38.018667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3cddcb34-e718-4455-8de7-972e6c673617 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:38.025254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cddcb34-e718-4455-8de7-972e6c673617 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:38.025712 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cddcb34-e718-4455-8de7-972e6c673617 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:38.026473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cddcb34-e718-4455-8de7-972e6c673617 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:38.026909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cddcb34-e718-4455-8de7-972e6c673617 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:38.227431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3cddcb34-e718-4455-8de7-972e6c673617 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:38.237427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3cddcb34-e718-4455-8de7-972e6c673617 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.223779 Jun 27 15:03:38.238019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 760/1010] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:38 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:38.242942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-533026ac-75b6-44c2-a7cf-5d996a6d5450 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:38.243550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-533026ac-75b6-44c2-a7cf-5d996a6d5450 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:38.256019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-533026ac-75b6-44c2-a7cf-5d996a6d5450 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:38.256786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-533026ac-75b6-44c2-a7cf-5d996a6d5450 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:38.257729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-533026ac-75b6-44c2-a7cf-5d996a6d5450 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:38.258330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-533026ac-75b6-44c2-a7cf-5d996a6d5450 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:38.392328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-533026ac-75b6-44c2-a7cf-5d996a6d5450 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:38.400022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-533026ac-75b6-44c2-a7cf-5d996a6d5450 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.160733 Jun 27 15:03:38.400791 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 761/1011] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:38 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:38.423360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c21e38b4-03a3-415b-ae46-0a2fb3b158f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:38.423973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c21e38b4-03a3-415b-ae46-0a2fb3b158f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:38.430002 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c21e38b4-03a3-415b-ae46-0a2fb3b158f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:38.430444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c21e38b4-03a3-415b-ae46-0a2fb3b158f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:38.431202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c21e38b4-03a3-415b-ae46-0a2fb3b158f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:38.431627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c21e38b4-03a3-415b-ae46-0a2fb3b158f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:38.582901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c21e38b4-03a3-415b-ae46-0a2fb3b158f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:38.591256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c21e38b4-03a3-415b-ae46-0a2fb3b158f2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.172216 Jun 27 15:03:38.591877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 762/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:38 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:38.603571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-970f82a1-7253-4088-aa53-2ca5485816a8 req-cdf9470d-4a21-4856-8366-19d8650d835f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f842ec7-32eb-4898-8b26-dbb78e4616ea", "tag": "1f7a74e1-df0c-4bb9-a6cc-049be091782f"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:38.613107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-970f82a1-7253-4088-aa53-2ca5485816a8 req-cdf9470d-4a21-4856-8366-19d8650d835f service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:38.619212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-970f82a1-7253-4088-aa53-2ca5485816a8 req-cdf9470d-4a21-4856-8366-19d8650d835f service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:38.626913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-970f82a1-7253-4088-aa53-2ca5485816a8 req-cdf9470d-4a21-4856-8366-19d8650d835f service nova] Creating event network-changed:1f7a74e1-df0c-4bb9-a6cc-049be091782f for instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea on hv-cinder-79760 Jun 27 15:03:38.632426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-970f82a1-7253-4088-aa53-2ca5485816a8 req-cdf9470d-4a21-4856-8366-19d8650d835f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039211 Jun 27 15:03:38.633112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 763/1013] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:03:38.996306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5c778f2a-9fa2-41bd-848a-7161775ff979 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:38.997283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5c778f2a-9fa2-41bd-848a-7161775ff979 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:39.000693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:39.004461 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c778f2a-9fa2-41bd-848a-7161775ff979 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:39.005149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c778f2a-9fa2-41bd-848a-7161775ff979 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:39.005920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c778f2a-9fa2-41bd-848a-7161775ff979 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:39.006350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c778f2a-9fa2-41bd-848a-7161775ff979 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:39.237455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5c778f2a-9fa2-41bd-848a-7161775ff979 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:39.247136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5c778f2a-9fa2-41bd-848a-7161775ff979 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.255484 Jun 27 15:03:39.247716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 764/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:38 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:39.257618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-96f57825-c2bd-4202-8169-714970e87f95 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:39.258299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-96f57825-c2bd-4202-8169-714970e87f95 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:39.264417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96f57825-c2bd-4202-8169-714970e87f95 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:39.265085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96f57825-c2bd-4202-8169-714970e87f95 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:39.265885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96f57825-c2bd-4202-8169-714970e87f95 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:39.266328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96f57825-c2bd-4202-8169-714970e87f95 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:39.459504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-96f57825-c2bd-4202-8169-714970e87f95 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:39.477227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-96f57825-c2bd-4202-8169-714970e87f95 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.225034 Jun 27 15:03:39.478027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 765/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:39 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:39.482890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c4cc4f02-8eb9-47e4-8096-f876a3504403 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:39.483824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c4cc4f02-8eb9-47e4-8096-f876a3504403 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:39.491219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4cc4f02-8eb9-47e4-8096-f876a3504403 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:39.491743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4cc4f02-8eb9-47e4-8096-f876a3504403 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:39.495872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4cc4f02-8eb9-47e4-8096-f876a3504403 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:39.495872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c4cc4f02-8eb9-47e4-8096-f876a3504403 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:39.625118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c4cc4f02-8eb9-47e4-8096-f876a3504403 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:39.632429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c4cc4f02-8eb9-47e4-8096-f876a3504403 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.153177 Jun 27 15:03:39.633019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 766/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:39 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:39.637714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4758a800-7add-4e0f-b9ff-5661e0b21b9d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:39.638309 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4758a800-7add-4e0f-b9ff-5661e0b21b9d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:39.644330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4758a800-7add-4e0f-b9ff-5661e0b21b9d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:39.644804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4758a800-7add-4e0f-b9ff-5661e0b21b9d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:39.645681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4758a800-7add-4e0f-b9ff-5661e0b21b9d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:39.646109 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4758a800-7add-4e0f-b9ff-5661e0b21b9d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:39.776200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4758a800-7add-4e0f-b9ff-5661e0b21b9d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:39.785643 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4758a800-7add-4e0f-b9ff-5661e0b21b9d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.151567 Jun 27 15:03:39.786212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 767/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:39 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:40.264830 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8dff4ff1-3f31-4ae1-951a-02ac4e6ca110 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:40.265435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8dff4ff1-3f31-4ae1-951a-02ac4e6ca110 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:40.272435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8dff4ff1-3f31-4ae1-951a-02ac4e6ca110 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:40.272905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8dff4ff1-3f31-4ae1-951a-02ac4e6ca110 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:40.273657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8dff4ff1-3f31-4ae1-951a-02ac4e6ca110 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:40.274083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8dff4ff1-3f31-4ae1-951a-02ac4e6ca110 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:40.400321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8dff4ff1-3f31-4ae1-951a-02ac4e6ca110 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:40.408001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8dff4ff1-3f31-4ae1-951a-02ac4e6ca110 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.147034 Jun 27 15:03:40.408561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 768/1018] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:40 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:40.495354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-50797934-f2f0-4a2f-b2f2-cd4e17b42c20 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:40.495952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-50797934-f2f0-4a2f-b2f2-cd4e17b42c20 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:40.502345 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-50797934-f2f0-4a2f-b2f2-cd4e17b42c20 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:40.502789 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-50797934-f2f0-4a2f-b2f2-cd4e17b42c20 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:40.503539 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-50797934-f2f0-4a2f-b2f2-cd4e17b42c20 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:40.503969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-50797934-f2f0-4a2f-b2f2-cd4e17b42c20 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:40.642889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-50797934-f2f0-4a2f-b2f2-cd4e17b42c20 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:40.651302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-50797934-f2f0-4a2f-b2f2-cd4e17b42c20 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.159529 Jun 27 15:03:40.651805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 769/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:40 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:40.656154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d850fa62-2299-4839-adf5-f0233a1fadc2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:40.657323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d850fa62-2299-4839-adf5-f0233a1fadc2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:40.662825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d850fa62-2299-4839-adf5-f0233a1fadc2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:40.663276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d850fa62-2299-4839-adf5-f0233a1fadc2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:40.664030 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d850fa62-2299-4839-adf5-f0233a1fadc2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:40.664464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d850fa62-2299-4839-adf5-f0233a1fadc2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:40.668287 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:40.794576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d850fa62-2299-4839-adf5-f0233a1fadc2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:40.802596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d850fa62-2299-4839-adf5-f0233a1fadc2 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.149849 Jun 27 15:03:40.803178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 770/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:40 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:40.807598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-121ab2fb-f571-4be6-af6b-9b67d1b4cf84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:40.808191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-121ab2fb-f571-4be6-af6b-9b67d1b4cf84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:40.814783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-121ab2fb-f571-4be6-af6b-9b67d1b4cf84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:40.815223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-121ab2fb-f571-4be6-af6b-9b67d1b4cf84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:40.815966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-121ab2fb-f571-4be6-af6b-9b67d1b4cf84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:40.816393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-121ab2fb-f571-4be6-af6b-9b67d1b4cf84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:40.943782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-121ab2fb-f571-4be6-af6b-9b67d1b4cf84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:40.951678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-121ab2fb-f571-4be6-af6b-9b67d1b4cf84 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.147555 Jun 27 15:03:40.952246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 771/1021] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:40 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:41.425226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4710b9a8-a714-469e-a18d-c7463e293115 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:41.425849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4710b9a8-a714-469e-a18d-c7463e293115 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:41.432259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4710b9a8-a714-469e-a18d-c7463e293115 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:41.432729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4710b9a8-a714-469e-a18d-c7463e293115 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:41.433736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4710b9a8-a714-469e-a18d-c7463e293115 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:41.434163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4710b9a8-a714-469e-a18d-c7463e293115 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:41.566227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4710b9a8-a714-469e-a18d-c7463e293115 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:41.573601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4710b9a8-a714-469e-a18d-c7463e293115 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.152395 Jun 27 15:03:41.574161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 772/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:41 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:41.666841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-22875b84-4cc8-4b0c-b3de-83987dc3872f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:41.667440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-22875b84-4cc8-4b0c-b3de-83987dc3872f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:41.673535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22875b84-4cc8-4b0c-b3de-83987dc3872f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:41.673975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22875b84-4cc8-4b0c-b3de-83987dc3872f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:41.674721 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22875b84-4cc8-4b0c-b3de-83987dc3872f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:41.675145 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-22875b84-4cc8-4b0c-b3de-83987dc3872f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:41.812626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-22875b84-4cc8-4b0c-b3de-83987dc3872f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:41.821016 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-22875b84-4cc8-4b0c-b3de-83987dc3872f tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.157798 Jun 27 15:03:41.821576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 773/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:41 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:41.825966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-14930853-37e0-4489-a0bc-ca8706501b9f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:41.826566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-14930853-37e0-4489-a0bc-ca8706501b9f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:41.832739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-14930853-37e0-4489-a0bc-ca8706501b9f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:41.833195 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-14930853-37e0-4489-a0bc-ca8706501b9f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:41.833942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-14930853-37e0-4489-a0bc-ca8706501b9f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:41.834371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-14930853-37e0-4489-a0bc-ca8706501b9f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:41.961333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-14930853-37e0-4489-a0bc-ca8706501b9f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:41.968702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-14930853-37e0-4489-a0bc-ca8706501b9f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.146180 Jun 27 15:03:41.969309 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 774/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:41 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:41.973702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-944be8e2-9b10-4e1b-9044-bedf3bc4f50d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:41.974296 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-944be8e2-9b10-4e1b-9044-bedf3bc4f50d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:41.979779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-944be8e2-9b10-4e1b-9044-bedf3bc4f50d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:41.980222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-944be8e2-9b10-4e1b-9044-bedf3bc4f50d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:41.981007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-944be8e2-9b10-4e1b-9044-bedf3bc4f50d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:41.981436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-944be8e2-9b10-4e1b-9044-bedf3bc4f50d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:42.108777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-944be8e2-9b10-4e1b-9044-bedf3bc4f50d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:42.117333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-944be8e2-9b10-4e1b-9044-bedf3bc4f50d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.147094 Jun 27 15:03:42.117888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 775/1025] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:41 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:42.590875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6564cc0a-447f-46c6-8dd2-592283b646cd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:42.591503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6564cc0a-447f-46c6-8dd2-592283b646cd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:42.598740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6564cc0a-447f-46c6-8dd2-592283b646cd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:42.599187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6564cc0a-447f-46c6-8dd2-592283b646cd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:42.599942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6564cc0a-447f-46c6-8dd2-592283b646cd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:42.600378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6564cc0a-447f-46c6-8dd2-592283b646cd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:42.732838 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6564cc0a-447f-46c6-8dd2-592283b646cd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:42.741153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6564cc0a-447f-46c6-8dd2-592283b646cd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.154181 Jun 27 15:03:42.741712 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 776/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:42 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:42.838569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6204c81c-f648-4474-a1cd-88ee9930c3e1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:42.839257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6204c81c-f648-4474-a1cd-88ee9930c3e1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:42.845876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6204c81c-f648-4474-a1cd-88ee9930c3e1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:42.846324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6204c81c-f648-4474-a1cd-88ee9930c3e1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:42.847116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6204c81c-f648-4474-a1cd-88ee9930c3e1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:42.847551 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6204c81c-f648-4474-a1cd-88ee9930c3e1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:42.997313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6204c81c-f648-4474-a1cd-88ee9930c3e1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:43.005367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6204c81c-f648-4474-a1cd-88ee9930c3e1 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1758 microversion: 2.1 time: 0.170697 Jun 27 15:03:43.015174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 777/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:42 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:43.015174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-349757d4-6949-440a-a3c9-92bcf21760a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:43.015174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-349757d4-6949-440a-a3c9-92bcf21760a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:43.017592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-349757d4-6949-440a-a3c9-92bcf21760a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:43.018035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-349757d4-6949-440a-a3c9-92bcf21760a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:43.018828 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-349757d4-6949-440a-a3c9-92bcf21760a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:43.019258 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-349757d4-6949-440a-a3c9-92bcf21760a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:43.151781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-349757d4-6949-440a-a3c9-92bcf21760a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:43.159918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-349757d4-6949-440a-a3c9-92bcf21760a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.153023 Jun 27 15:03:43.160486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 778/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:43 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:43.164873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-09a006cf-7709-48bb-a641-7556f77729e9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:43.165469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-09a006cf-7709-48bb-a641-7556f77729e9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:43.171130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-09a006cf-7709-48bb-a641-7556f77729e9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:43.171568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-09a006cf-7709-48bb-a641-7556f77729e9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:43.172480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-09a006cf-7709-48bb-a641-7556f77729e9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:43.173110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-09a006cf-7709-48bb-a641-7556f77729e9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:43.303070 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-09a006cf-7709-48bb-a641-7556f77729e9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:43.311208 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-09a006cf-7709-48bb-a641-7556f77729e9 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.149772 Jun 27 15:03:43.311780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 779/1029] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:43 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:43.758084 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d96bcc9f-b0c5-426a-b3f4-039e0ec9030d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:43.758810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d96bcc9f-b0c5-426a-b3f4-039e0ec9030d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:43.765496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d96bcc9f-b0c5-426a-b3f4-039e0ec9030d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:43.766424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d96bcc9f-b0c5-426a-b3f4-039e0ec9030d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:43.767171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d96bcc9f-b0c5-426a-b3f4-039e0ec9030d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:43.767590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d96bcc9f-b0c5-426a-b3f4-039e0ec9030d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:43.896797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d96bcc9f-b0c5-426a-b3f4-039e0ec9030d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:43.904326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d96bcc9f-b0c5-426a-b3f4-039e0ec9030d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.150166 Jun 27 15:03:43.905172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 780/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:43 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:44.022936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9385f9b3-7918-4df4-876c-048de3000a02 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:44.023511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9385f9b3-7918-4df4-876c-048de3000a02 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:44.029367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9385f9b3-7918-4df4-876c-048de3000a02 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:44.029812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9385f9b3-7918-4df4-876c-048de3000a02 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:44.030568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9385f9b3-7918-4df4-876c-048de3000a02 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:44.031038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9385f9b3-7918-4df4-876c-048de3000a02 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:44.172959 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9385f9b3-7918-4df4-876c-048de3000a02 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:44.180833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9385f9b3-7918-4df4-876c-048de3000a02 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1761 microversion: 2.1 time: 0.161625 Jun 27 15:03:44.181385 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 781/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:44 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1761 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:44.186080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f1c91a48-6469-469a-990c-f68139c4355f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:44.186668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f1c91a48-6469-469a-990c-f68139c4355f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:44.192310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f1c91a48-6469-469a-990c-f68139c4355f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:44.192791 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f1c91a48-6469-469a-990c-f68139c4355f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:44.193561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f1c91a48-6469-469a-990c-f68139c4355f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:44.193985 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f1c91a48-6469-469a-990c-f68139c4355f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:44.294912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:44.324245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f1c91a48-6469-469a-990c-f68139c4355f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:44.332672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f1c91a48-6469-469a-990c-f68139c4355f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.150221 Jun 27 15:03:44.333379 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 782/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:44 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:44.337819 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fd7c5263-7564-4886-bfd7-80a04b6ebb38 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:44.338427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fd7c5263-7564-4886-bfd7-80a04b6ebb38 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:44.344957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fd7c5263-7564-4886-bfd7-80a04b6ebb38 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:44.345493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fd7c5263-7564-4886-bfd7-80a04b6ebb38 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:44.346256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fd7c5263-7564-4886-bfd7-80a04b6ebb38 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:44.346687 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fd7c5263-7564-4886-bfd7-80a04b6ebb38 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:44.482267 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fd7c5263-7564-4886-bfd7-80a04b6ebb38 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:44.490309 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fd7c5263-7564-4886-bfd7-80a04b6ebb38 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.155985 Jun 27 15:03:44.490877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 783/1033] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:44 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:44.921445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3e3611c8-8e50-4cdd-872c-3b55273fa3ca tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:44.922207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3e3611c8-8e50-4cdd-872c-3b55273fa3ca tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:44.924709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=12 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:44.929685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e3611c8-8e50-4cdd-872c-3b55273fa3ca tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:44.930133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e3611c8-8e50-4cdd-872c-3b55273fa3ca tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:44.930894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e3611c8-8e50-4cdd-872c-3b55273fa3ca tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:44.931325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e3611c8-8e50-4cdd-872c-3b55273fa3ca tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:45.104875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3e3611c8-8e50-4cdd-872c-3b55273fa3ca tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:45.115155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3e3611c8-8e50-4cdd-872c-3b55273fa3ca tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.197513 Jun 27 15:03:45.115743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 784/1034] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:44 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:45.349851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-80635d37-e5f5-4558-ab37-2ff832cecb42 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:45.350508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-80635d37-e5f5-4558-ab37-2ff832cecb42 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:45.356782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80635d37-e5f5-4558-ab37-2ff832cecb42 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:45.357235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80635d37-e5f5-4558-ab37-2ff832cecb42 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:45.357997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80635d37-e5f5-4558-ab37-2ff832cecb42 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:45.358431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80635d37-e5f5-4558-ab37-2ff832cecb42 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:45.500277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-80635d37-e5f5-4558-ab37-2ff832cecb42 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:45.508061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-80635d37-e5f5-4558-ab37-2ff832cecb42 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.162238 Jun 27 15:03:45.508619 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 785/1035] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:45 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:45.512950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9ed85fba-00c1-488b-ac39-30ef134db541 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:45.513542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9ed85fba-00c1-488b-ac39-30ef134db541 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:45.519124 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ed85fba-00c1-488b-ac39-30ef134db541 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:45.519560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ed85fba-00c1-488b-ac39-30ef134db541 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:45.520301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ed85fba-00c1-488b-ac39-30ef134db541 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:45.520749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ed85fba-00c1-488b-ac39-30ef134db541 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:45.653204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9ed85fba-00c1-488b-ac39-30ef134db541 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:45.657133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:45.661903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9ed85fba-00c1-488b-ac39-30ef134db541 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.152339 Jun 27 15:03:45.662462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 786/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:45 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:45.667013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c363c9a1-ba6e-4325-8800-79ebed0f88a0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:45.669677 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c363c9a1-ba6e-4325-8800-79ebed0f88a0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:45.673665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c363c9a1-ba6e-4325-8800-79ebed0f88a0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:45.674116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c363c9a1-ba6e-4325-8800-79ebed0f88a0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:45.674867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c363c9a1-ba6e-4325-8800-79ebed0f88a0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:45.675292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c363c9a1-ba6e-4325-8800-79ebed0f88a0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:45.703618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c363c9a1-ba6e-4325-8800-79ebed0f88a0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments/12d6dae0-7080-44cd-ab30-337bb16e04e9" status: 200 len: 194 microversion: 2.20 time: 0.039967 Jun 27 15:03:45.704669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 787/1037] 10.222.0.44 () {60 vars in 1453 bytes} [Mon Jun 27 15:03:45 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments/12d6dae0-7080-44cd-ab30-337bb16e04e9 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:03:45.768215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f4a258bc-087b-4345-839a-5fa39b9f9930 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:45.768746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f4a258bc-087b-4345-839a-5fa39b9f9930 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:45.774671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4a258bc-087b-4345-839a-5fa39b9f9930 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:45.775113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4a258bc-087b-4345-839a-5fa39b9f9930 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:45.775864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4a258bc-087b-4345-839a-5fa39b9f9930 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:45.776297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4a258bc-087b-4345-839a-5fa39b9f9930 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:45.856047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-f4a258bc-087b-4345-839a-5fa39b9f9930 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lazy-loading 'services' on Instance uuid d67eac8a-bfba-489d-8d6d-11956e1b4e90 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:03:46.020459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f4a258bc-087b-4345-839a-5fa39b9f9930 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments/12d6dae0-7080-44cd-ab30-337bb16e04e9" status: 202 len: 0 microversion: 2.20 time: 0.256139 Jun 27 15:03:46.021092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 788/1038] 10.222.0.44 () {60 vars in 1456 bytes} [Mon Jun 27 15:03:45 2022] DELETE /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments/12d6dae0-7080-44cd-ab30-337bb16e04e9 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:03:46.029781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3dd6dc2b-6e3f-4dfb-9e21-7db2df79781c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:46.030831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3dd6dc2b-6e3f-4dfb-9e21-7db2df79781c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:46.037639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3dd6dc2b-6e3f-4dfb-9e21-7db2df79781c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:46.038052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3dd6dc2b-6e3f-4dfb-9e21-7db2df79781c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:46.038806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3dd6dc2b-6e3f-4dfb-9e21-7db2df79781c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:46.039236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3dd6dc2b-6e3f-4dfb-9e21-7db2df79781c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:46.067456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3dd6dc2b-6e3f-4dfb-9e21-7db2df79781c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041724 Jun 27 15:03:46.067996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 789/1039] 10.222.0.44 () {60 vars in 1342 bytes} [Mon Jun 27 15:03:46 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:03:46.132561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-823bc94d-1ee9-4b0c-99e1-2620c8e73757 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:46.133194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-823bc94d-1ee9-4b0c-99e1-2620c8e73757 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:46.139139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-823bc94d-1ee9-4b0c-99e1-2620c8e73757 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:46.139580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-823bc94d-1ee9-4b0c-99e1-2620c8e73757 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:46.140321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-823bc94d-1ee9-4b0c-99e1-2620c8e73757 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:46.141338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-823bc94d-1ee9-4b0c-99e1-2620c8e73757 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:46.528693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-823bc94d-1ee9-4b0c-99e1-2620c8e73757 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:46.539582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-823bc94d-1ee9-4b0c-99e1-2620c8e73757 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.407871 Jun 27 15:03:46.539582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 790/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:46 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:46.542151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-2103443f-6d53-439c-b96f-a240e277a220 req-275829e2-2a94-40c2-b485-c26df6ea4311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f842ec7-32eb-4898-8b26-dbb78e4616ea", "name": "network-vif-plugged", "status": "completed", "tag": "1f7a74e1-df0c-4bb9-a6cc-049be091782f"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:46.550959 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-2103443f-6d53-439c-b96f-a240e277a220 req-275829e2-2a94-40c2-b485-c26df6ea4311 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:46.551392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-2103443f-6d53-439c-b96f-a240e277a220 req-275829e2-2a94-40c2-b485-c26df6ea4311 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:46.563891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-2103443f-6d53-439c-b96f-a240e277a220 req-275829e2-2a94-40c2-b485-c26df6ea4311 service nova] Creating event network-vif-plugged:1f7a74e1-df0c-4bb9-a6cc-049be091782f for instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea on hv-cinder-79760 Jun 27 15:03:46.568804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-2103443f-6d53-439c-b96f-a240e277a220 req-275829e2-2a94-40c2-b485-c26df6ea4311 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029989 Jun 27 15:03:46.569392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 791/1041] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:03:46.574242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-75aba537-6a43-44df-95b4-e9abb109663b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:46.574924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-75aba537-6a43-44df-95b4-e9abb109663b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:46.581470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-75aba537-6a43-44df-95b4-e9abb109663b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:46.581910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-75aba537-6a43-44df-95b4-e9abb109663b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:46.582681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-75aba537-6a43-44df-95b4-e9abb109663b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:46.583088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-75aba537-6a43-44df-95b4-e9abb109663b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:46.719497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-75aba537-6a43-44df-95b4-e9abb109663b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:46.727065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-75aba537-6a43-44df-95b4-e9abb109663b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.156595 Jun 27 15:03:46.727699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 792/1042] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:46 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:46.732172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8289b7e7-cf5c-4b84-9f7f-010c962d679f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:46.732789 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8289b7e7-cf5c-4b84-9f7f-010c962d679f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:46.738968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8289b7e7-cf5c-4b84-9f7f-010c962d679f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:46.739410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8289b7e7-cf5c-4b84-9f7f-010c962d679f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:46.740154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8289b7e7-cf5c-4b84-9f7f-010c962d679f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:46.740580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8289b7e7-cf5c-4b84-9f7f-010c962d679f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:46.872988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8289b7e7-cf5c-4b84-9f7f-010c962d679f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:46.881630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8289b7e7-cf5c-4b84-9f7f-010c962d679f tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1736 microversion: 2.1 time: 0.152915 Jun 27 15:03:46.882189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 793/1043] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:46 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:47.078635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-26c2d1a3-d5a5-41d4-811f-1b2bbdc4e5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:47.079871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-26c2d1a3-d5a5-41d4-811f-1b2bbdc4e5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:47.086694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-26c2d1a3-d5a5-41d4-811f-1b2bbdc4e5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:47.087304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-26c2d1a3-d5a5-41d4-811f-1b2bbdc4e5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:47.088068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-26c2d1a3-d5a5-41d4-811f-1b2bbdc4e5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:47.088494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-26c2d1a3-d5a5-41d4-811f-1b2bbdc4e5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:47.119646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-26c2d1a3-d5a5-41d4-811f-1b2bbdc4e5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045117 Jun 27 15:03:47.120199 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 794/1044] 10.222.0.44 () {60 vars in 1342 bytes} [Mon Jun 27 15:03:47 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:03:47.554182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9f74d48f-416e-4b3b-ad1b-24916ddfbec5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:47.554777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9f74d48f-416e-4b3b-ad1b-24916ddfbec5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:47.560990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f74d48f-416e-4b3b-ad1b-24916ddfbec5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:47.561457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f74d48f-416e-4b3b-ad1b-24916ddfbec5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:47.562196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f74d48f-416e-4b3b-ad1b-24916ddfbec5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:47.562697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f74d48f-416e-4b3b-ad1b-24916ddfbec5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:47.691352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9f74d48f-416e-4b3b-ad1b-24916ddfbec5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:47.699291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9f74d48f-416e-4b3b-ad1b-24916ddfbec5 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.148922 Jun 27 15:03:47.700053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 795/1045] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:47 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:47.743980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-def414f0-31c8-4c65-a78a-ec8ae5cf67aa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:47.744607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-def414f0-31c8-4c65-a78a-ec8ae5cf67aa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:47.751028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-def414f0-31c8-4c65-a78a-ec8ae5cf67aa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:47.751667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-def414f0-31c8-4c65-a78a-ec8ae5cf67aa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:47.752419 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-def414f0-31c8-4c65-a78a-ec8ae5cf67aa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:47.752907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-def414f0-31c8-4c65-a78a-ec8ae5cf67aa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:47.889365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-def414f0-31c8-4c65-a78a-ec8ae5cf67aa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:47.897857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-def414f0-31c8-4c65-a78a-ec8ae5cf67aa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.157834 Jun 27 15:03:47.898434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 796/1046] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:47 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:47.902884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-18ada361-4357-4d39-99f8-bc2b8419ea89 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:47.903476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-18ada361-4357-4d39-99f8-bc2b8419ea89 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:47.909524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18ada361-4357-4d39-99f8-bc2b8419ea89 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:47.909970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18ada361-4357-4d39-99f8-bc2b8419ea89 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:47.910750 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18ada361-4357-4d39-99f8-bc2b8419ea89 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:47.911184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18ada361-4357-4d39-99f8-bc2b8419ea89 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.039976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-18ada361-4357-4d39-99f8-bc2b8419ea89 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:48.048502 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-18ada361-4357-4d39-99f8-bc2b8419ea89 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1716 microversion: 2.1 time: 0.149056 Jun 27 15:03:48.049101 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 797/1047] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:47 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:48.133172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8e8e4762-ff53-45f3-9f9a-0d5aa73910f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:48.134149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8e8e4762-ff53-45f3-9f9a-0d5aa73910f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:48.140524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e8e4762-ff53-45f3-9f9a-0d5aa73910f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.141578 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e8e4762-ff53-45f3-9f9a-0d5aa73910f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.142382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e8e4762-ff53-45f3-9f9a-0d5aa73910f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.142911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e8e4762-ff53-45f3-9f9a-0d5aa73910f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.173679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8e8e4762-ff53-45f3-9f9a-0d5aa73910f5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045858 Jun 27 15:03:48.174232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 798/1048] 10.222.0.44 () {60 vars in 1342 bytes} [Mon Jun 27 15:03:48 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:03:48.178780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:48.179253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:48.185135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.185607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.186352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.186779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.264509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] HTTP exception thrown: Cannot 'detach_volume' instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c while it is in vm_state rescued Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Request method failure captured: Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments/bc83b666-9d20-47cd-ab45-3b85e30edac6 HTTP/1.1 Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT-38-AhZx4ML0BgmtKnzrQGmAeYhVKp5jKaqxQFcQnA7Kr9cre3Cu91khx_2JaOxjv9r1Z9kio4dNU5xXRpzSPMGfJKKbnGnmOtztAdqgT6r_4hXcpZK59VXJPjHLS4pE-eo4l84UTzV0RLVRBOIDSf2e9NbVw6MW1nFAV0jqhI38 Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:03:48.266639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 27b0e2428571450ea1d5edfd1c3b0f80 Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:03:48.268184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Cannot 'detach_volume' instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c while it is in vm_state rescued Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'server_id': '7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c', 'id': 'bc83b666-9d20-47cd-ab45-3b85e30edac6'} Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:03:48.269069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c while it is in vm_state rescued Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c while it is in vm_state rescued Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:03:48.270552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Returning 409 to user: Cannot 'detach_volume' instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c while it is in vm_state rescued {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:03:48.272013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cf4453d9-5c64-479f-ac99-9ffb06bdb311 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments/bc83b666-9d20-47cd-ab45-3b85e30edac6" status: 409 len: 152 microversion: 2.1 time: 0.092856 Jun 27 15:03:48.272013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 799/1049] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:03:48 2022] DELETE /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments/bc83b666-9d20-47cd-ab45-3b85e30edac6 => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 15:03:48.276300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8dcdd684-ff52-4790-8d34-8f92013b20f5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:48.276847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8dcdd684-ff52-4790-8d34-8f92013b20f5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:48.283762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8dcdd684-ff52-4790-8d34-8f92013b20f5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.284210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8dcdd684-ff52-4790-8d34-8f92013b20f5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.284986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8dcdd684-ff52-4790-8d34-8f92013b20f5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.285417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8dcdd684-ff52-4790-8d34-8f92013b20f5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.470069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8dcdd684-ff52-4790-8d34-8f92013b20f5 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "POST /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/action" status: 202 len: 0 microversion: 2.1 time: 0.196985 Jun 27 15:03:48.470727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 800/1050] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:03:48 2022] POST /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:03:48.479017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0b9e057d-242b-4dfd-8e27-522277c57d8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:48.479704 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0b9e057d-242b-4dfd-8e27-522277c57d8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:48.485900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b9e057d-242b-4dfd-8e27-522277c57d8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.486459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b9e057d-242b-4dfd-8e27-522277c57d8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.487228 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b9e057d-242b-4dfd-8e27-522277c57d8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.487658 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0b9e057d-242b-4dfd-8e27-522277c57d8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.619010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0b9e057d-242b-4dfd-8e27-522277c57d8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:48.627505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0b9e057d-242b-4dfd-8e27-522277c57d8e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1724 microversion: 2.1 time: 0.152498 Jun 27 15:03:48.628154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 801/1051] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:48 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:48.716579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9a9e59bd-7568-4fa8-8956-cf1976de7fe9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:48.717199 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9a9e59bd-7568-4fa8-8956-cf1976de7fe9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:48.723139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9a9e59bd-7568-4fa8-8956-cf1976de7fe9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.723576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9a9e59bd-7568-4fa8-8956-cf1976de7fe9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.724315 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9a9e59bd-7568-4fa8-8956-cf1976de7fe9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.724767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9a9e59bd-7568-4fa8-8956-cf1976de7fe9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.742154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:48.853245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9a9e59bd-7568-4fa8-8956-cf1976de7fe9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:48.860574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9a9e59bd-7568-4fa8-8956-cf1976de7fe9 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.147727 Jun 27 15:03:48.861778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 802/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:48 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:48.915119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3ab5e72b-89ee-4e24-9a16-f84b38a4aaf1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:48.915772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3ab5e72b-89ee-4e24-9a16-f84b38a4aaf1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:48.922611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ab5e72b-89ee-4e24-9a16-f84b38a4aaf1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.923055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ab5e72b-89ee-4e24-9a16-f84b38a4aaf1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:48.924407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ab5e72b-89ee-4e24-9a16-f84b38a4aaf1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:48.924897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ab5e72b-89ee-4e24-9a16-f84b38a4aaf1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:49.060464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3ab5e72b-89ee-4e24-9a16-f84b38a4aaf1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:49.068966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3ab5e72b-89ee-4e24-9a16-f84b38a4aaf1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.157955 Jun 27 15:03:49.069528 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 803/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:48 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:49.184944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d0c2e9b1-2b95-431c-bf04-e9592edad8dc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:49.185897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d0c2e9b1-2b95-431c-bf04-e9592edad8dc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:49.192772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b1-2b95-431c-bf04-e9592edad8dc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:49.193211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b1-2b95-431c-bf04-e9592edad8dc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:49.193962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b1-2b95-431c-bf04-e9592edad8dc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:49.194386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b1-2b95-431c-bf04-e9592edad8dc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:49.222648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d0c2e9b1-2b95-431c-bf04-e9592edad8dc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042047 Jun 27 15:03:49.223192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 804/1054] 10.222.0.44 () {60 vars in 1342 bytes} [Mon Jun 27 15:03:49 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:03:49.645042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f99d7576-a380-41dc-859f-0659d9ad8193 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:49.645648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f99d7576-a380-41dc-859f-0659d9ad8193 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:49.651828 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f99d7576-a380-41dc-859f-0659d9ad8193 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:49.652306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f99d7576-a380-41dc-859f-0659d9ad8193 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:49.653187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f99d7576-a380-41dc-859f-0659d9ad8193 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:49.653649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f99d7576-a380-41dc-859f-0659d9ad8193 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:49.783557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f99d7576-a380-41dc-859f-0659d9ad8193 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:49.791321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f99d7576-a380-41dc-859f-0659d9ad8193 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1724 microversion: 2.1 time: 0.150503 Jun 27 15:03:49.791881 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 805/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:49 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:49.878360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6d22db75-e649-48fa-aed7-96279439bf41 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:49.878986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6d22db75-e649-48fa-aed7-96279439bf41 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:49.884686 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6d22db75-e649-48fa-aed7-96279439bf41 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:49.885129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6d22db75-e649-48fa-aed7-96279439bf41 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:49.885870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6d22db75-e649-48fa-aed7-96279439bf41 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:49.886292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6d22db75-e649-48fa-aed7-96279439bf41 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:50.013083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6d22db75-e649-48fa-aed7-96279439bf41 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:50.020480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6d22db75-e649-48fa-aed7-96279439bf41 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.146540 Jun 27 15:03:50.021071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 806/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:49 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:50.085415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b33062d4-075c-45e0-bb0d-81a1de1fefc1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:50.086022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b33062d4-075c-45e0-bb0d-81a1de1fefc1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:50.092942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b33062d4-075c-45e0-bb0d-81a1de1fefc1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:50.093393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b33062d4-075c-45e0-bb0d-81a1de1fefc1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:50.094139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b33062d4-075c-45e0-bb0d-81a1de1fefc1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:50.094565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b33062d4-075c-45e0-bb0d-81a1de1fefc1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:50.237432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b33062d4-075c-45e0-bb0d-81a1de1fefc1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:50.244769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b33062d4-075c-45e0-bb0d-81a1de1fefc1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1367 microversion: 2.1 time: 0.163025 Jun 27 15:03:50.245341 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 807/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:50 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:50.249897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ad120df2-f3f9-4dd7-a0d8-239d690fc040 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:50.250851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ad120df2-f3f9-4dd7-a0d8-239d690fc040 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:50.256708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad120df2-f3f9-4dd7-a0d8-239d690fc040 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:50.257158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad120df2-f3f9-4dd7-a0d8-239d690fc040 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:50.257915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad120df2-f3f9-4dd7-a0d8-239d690fc040 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:50.258346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad120df2-f3f9-4dd7-a0d8-239d690fc040 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:50.287951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ad120df2-f3f9-4dd7-a0d8-239d690fc040 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041582 Jun 27 15:03:50.288516 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 808/1058] 10.222.0.44 () {60 vars in 1342 bytes} [Mon Jun 27 15:03:50 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:03:50.809642 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-456c7536-e631-4ea0-9a4d-dc73da1f18c8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:50.810239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-456c7536-e631-4ea0-9a4d-dc73da1f18c8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:50.816321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-456c7536-e631-4ea0-9a4d-dc73da1f18c8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:50.816847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-456c7536-e631-4ea0-9a4d-dc73da1f18c8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:50.817596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-456c7536-e631-4ea0-9a4d-dc73da1f18c8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:50.818019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-456c7536-e631-4ea0-9a4d-dc73da1f18c8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:50.945361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-456c7536-e631-4ea0-9a4d-dc73da1f18c8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:50.953436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-456c7536-e631-4ea0-9a4d-dc73da1f18c8 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1724 microversion: 2.1 time: 0.147904 Jun 27 15:03:50.953999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 809/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:50 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:51.037469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fdcf93f6-58f9-44c8-921b-68ca8356865c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:51.038224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fdcf93f6-58f9-44c8-921b-68ca8356865c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:51.044100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fdcf93f6-58f9-44c8-921b-68ca8356865c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.044546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fdcf93f6-58f9-44c8-921b-68ca8356865c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.046217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fdcf93f6-58f9-44c8-921b-68ca8356865c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.046217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fdcf93f6-58f9-44c8-921b-68ca8356865c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.182104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fdcf93f6-58f9-44c8-921b-68ca8356865c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:51.193405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fdcf93f6-58f9-44c8-921b-68ca8356865c tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.159703 Jun 27 15:03:51.194835 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 810/1060] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:51 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:51.261838 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-302e3590-b1e5-4b6b-91fa-510e4a1859e8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:51.262538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-302e3590-b1e5-4b6b-91fa-510e4a1859e8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:51.268552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-302e3590-b1e5-4b6b-91fa-510e4a1859e8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.272058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-302e3590-b1e5-4b6b-91fa-510e4a1859e8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.272058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-302e3590-b1e5-4b6b-91fa-510e4a1859e8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.272058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-302e3590-b1e5-4b6b-91fa-510e4a1859e8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.476913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-302e3590-b1e5-4b6b-91fa-510e4a1859e8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:51.484538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-302e3590-b1e5-4b6b-91fa-510e4a1859e8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1557 microversion: 2.1 time: 0.226875 Jun 27 15:03:51.485127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 811/1061] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:51 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1557 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:51.490590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-01e3444a-45fb-4854-baf7-ebcf00603db6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:51.491528 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-01e3444a-45fb-4854-baf7-ebcf00603db6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:51.497305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01e3444a-45fb-4854-baf7-ebcf00603db6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.497747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01e3444a-45fb-4854-baf7-ebcf00603db6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.498493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01e3444a-45fb-4854-baf7-ebcf00603db6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.498949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-01e3444a-45fb-4854-baf7-ebcf00603db6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.527988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-01e3444a-45fb-4854-baf7-ebcf00603db6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041831 Jun 27 15:03:51.528544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 812/1062] 10.222.0.44 () {60 vars in 1342 bytes} [Mon Jun 27 15:03:51 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:51.533445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-df499d6a-1f43-4300-8c4f-612d2d0bd2d6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:51.533672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-df499d6a-1f43-4300-8c4f-612d2d0bd2d6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:51.539760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df499d6a-1f43-4300-8c4f-612d2d0bd2d6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.540200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df499d6a-1f43-4300-8c4f-612d2d0bd2d6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.540978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df499d6a-1f43-4300-8c4f-612d2d0bd2d6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.541474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df499d6a-1f43-4300-8c4f-612d2d0bd2d6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.637252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-df499d6a-1f43-4300-8c4f-612d2d0bd2d6 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107610 Jun 27 15:03:51.637842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 813/1063] 10.222.0.44 () {58 vars in 1274 bytes} [Mon Jun 27 15:03:51 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:03:51.642891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0cea45a2-5f2b-49a3-9f6c-c626b5c13031 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:51.643377 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0cea45a2-5f2b-49a3-9f6c-c626b5c13031 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:51.646329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:51.649843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0cea45a2-5f2b-49a3-9f6c-c626b5c13031 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.650284 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0cea45a2-5f2b-49a3-9f6c-c626b5c13031 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.651042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0cea45a2-5f2b-49a3-9f6c-c626b5c13031 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.651469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0cea45a2-5f2b-49a3-9f6c-c626b5c13031 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.677664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0cea45a2-5f2b-49a3-9f6c-c626b5c13031 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:03:51.951096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0cea45a2-5f2b-49a3-9f6c-c626b5c13031 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 204 len: 0 microversion: 2.20 time: 0.311950 Jun 27 15:03:51.951713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 814/1064] 10.222.0.44 () {60 vars in 1279 bytes} [Mon Jun 27 15:03:51 2022] DELETE /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 15:03:51.960344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:51.961053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:51.967128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.967575 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:51.968357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:51.968834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:52.105943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:52.115025 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:52.120209 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:52.120209 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-74fd9e00-0b01-4461-b517-614906f911ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.161779 Jun 27 15:03:52.120209 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 815/1065] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:03:51 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:03:52.123035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-25a00926-aff0-4f0b-83f9-a529cd3af167 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:52.123705 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-25a00926-aff0-4f0b-83f9-a529cd3af167 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:52.130271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-25a00926-aff0-4f0b-83f9-a529cd3af167 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:52.130716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-25a00926-aff0-4f0b-83f9-a529cd3af167 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:52.131462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-25a00926-aff0-4f0b-83f9-a529cd3af167 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:52.131895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-25a00926-aff0-4f0b-83f9-a529cd3af167 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:52.260826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-25a00926-aff0-4f0b-83f9-a529cd3af167 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:52.269165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-25a00926-aff0-4f0b-83f9-a529cd3af167 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1724 microversion: 2.1 time: 0.149753 Jun 27 15:03:52.279259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 816/1066] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:52 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:52.279259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c8efa65d-a8d4-42d2-8394-65e83a875650 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:52.279259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c8efa65d-a8d4-42d2-8394-65e83a875650 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:52.281088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8efa65d-a8d4-42d2-8394-65e83a875650 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:52.281639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8efa65d-a8d4-42d2-8394-65e83a875650 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:52.282392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8efa65d-a8d4-42d2-8394-65e83a875650 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:52.283329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c8efa65d-a8d4-42d2-8394-65e83a875650 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:52.432480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c8efa65d-a8d4-42d2-8394-65e83a875650 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:52.436572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:52.441857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c8efa65d-a8d4-42d2-8394-65e83a875650 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.170937 Jun 27 15:03:52.449360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 817/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:52 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:52.868372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-6b544001-3b86-4547-bcbf-74dcf95a9a1d req-25f0acec-1b13-4381-aa7c-86667177301e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f842ec7-32eb-4898-8b26-dbb78e4616ea", "tag": "1f7a74e1-df0c-4bb9-a6cc-049be091782f"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:52.878174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6b544001-3b86-4547-bcbf-74dcf95a9a1d req-25f0acec-1b13-4381-aa7c-86667177301e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:52.878618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6b544001-3b86-4547-bcbf-74dcf95a9a1d req-25f0acec-1b13-4381-aa7c-86667177301e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:52.889748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-6b544001-3b86-4547-bcbf-74dcf95a9a1d req-25f0acec-1b13-4381-aa7c-86667177301e service nova] Creating event network-changed:1f7a74e1-df0c-4bb9-a6cc-049be091782f for instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea on hv-cinder-79760 Jun 27 15:03:52.895429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-6b544001-3b86-4547-bcbf-74dcf95a9a1d req-25f0acec-1b13-4381-aa7c-86667177301e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030922 Jun 27 15:03:52.896048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 818/1068] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:03:53.137445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:53.138132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:53.145346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:53.145790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:53.146550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:53.146981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:53.283120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:53.291069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:53.292579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:53.293751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d1f8ec29-6393-4386-9a2f-97e1ed39e616 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.160992 Jun 27 15:03:53.294300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 819/1069] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:03:53 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:03:53.299207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d9db2e92-9bf3-4578-a67e-2aade3e86d95 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:53.300075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d9db2e92-9bf3-4578-a67e-2aade3e86d95 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:53.305761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9db2e92-9bf3-4578-a67e-2aade3e86d95 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:53.306218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9db2e92-9bf3-4578-a67e-2aade3e86d95 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:53.306954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9db2e92-9bf3-4578-a67e-2aade3e86d95 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:53.307377 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9db2e92-9bf3-4578-a67e-2aade3e86d95 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:53.441914 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d9db2e92-9bf3-4578-a67e-2aade3e86d95 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:53.450252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d9db2e92-9bf3-4578-a67e-2aade3e86d95 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1724 microversion: 2.1 time: 0.154917 Jun 27 15:03:53.450850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 820/1070] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:53 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:53.466206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f4153666-b43a-4488-9270-9cb8bf06e189 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:53.466811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f4153666-b43a-4488-9270-9cb8bf06e189 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:53.473695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4153666-b43a-4488-9270-9cb8bf06e189 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:53.474155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4153666-b43a-4488-9270-9cb8bf06e189 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:53.474902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4153666-b43a-4488-9270-9cb8bf06e189 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:53.475333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f4153666-b43a-4488-9270-9cb8bf06e189 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:53.615736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f4153666-b43a-4488-9270-9cb8bf06e189 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:53.623660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f4153666-b43a-4488-9270-9cb8bf06e189 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.161138 Jun 27 15:03:53.624699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 821/1071] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:53 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:54.311719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:54.312315 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:54.319446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:54.319894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:54.320661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:54.321091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:54.453492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:54.461342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:54.462834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:54.463982 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8f5071ed-4e4a-481f-8176-29c30104e3e5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.156469 Jun 27 15:03:54.464530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 822/1072] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:03:54 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:03:54.468841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a1bb3fb2-64c7-422c-8fa6-5ffa1403ebc1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:54.469432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a1bb3fb2-64c7-422c-8fa6-5ffa1403ebc1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:54.475953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a1bb3fb2-64c7-422c-8fa6-5ffa1403ebc1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:54.476399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a1bb3fb2-64c7-422c-8fa6-5ffa1403ebc1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:54.477306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a1bb3fb2-64c7-422c-8fa6-5ffa1403ebc1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:54.477744 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a1bb3fb2-64c7-422c-8fa6-5ffa1403ebc1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:54.606397 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a1bb3fb2-64c7-422c-8fa6-5ffa1403ebc1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:54.615097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a1bb3fb2-64c7-422c-8fa6-5ffa1403ebc1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1724 microversion: 2.1 time: 0.149577 Jun 27 15:03:54.615656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 823/1073] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:54 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:54.640081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b9a59582-5f1d-4155-9e5b-96dbad6d309b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:54.640706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b9a59582-5f1d-4155-9e5b-96dbad6d309b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:54.646535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b9a59582-5f1d-4155-9e5b-96dbad6d309b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:54.646975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b9a59582-5f1d-4155-9e5b-96dbad6d309b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:54.647726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b9a59582-5f1d-4155-9e5b-96dbad6d309b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:54.648156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b9a59582-5f1d-4155-9e5b-96dbad6d309b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:54.776191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b9a59582-5f1d-4155-9e5b-96dbad6d309b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:54.784110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b9a59582-5f1d-4155-9e5b-96dbad6d309b tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.147598 Jun 27 15:03:54.784689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 824/1074] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:54 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:54.999287 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-d5b63405-e591-4149-bc44-adea31a12df6 req-711605db-a09c-416d-a380-7ffc7ca1248a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c8875-88c6-490f-a2a7-b0332d129e3d", "name": "network-vif-plugged", "status": "completed", "tag": "05abf890-aa38-4cf8-b0bb-92c6ba77980d"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:55.007643 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-d5b63405-e591-4149-bc44-adea31a12df6 req-711605db-a09c-416d-a380-7ffc7ca1248a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:55.017526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-d5b63405-e591-4149-bc44-adea31a12df6 req-711605db-a09c-416d-a380-7ffc7ca1248a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:55.019866 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-d5b63405-e591-4149-bc44-adea31a12df6 req-711605db-a09c-416d-a380-7ffc7ca1248a service nova] Creating event network-vif-plugged:05abf890-aa38-4cf8-b0bb-92c6ba77980d for instance e08c8875-88c6-490f-a2a7-b0332d129e3d on hv-cinder-79760 Jun 27 15:03:55.024857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-d5b63405-e591-4149-bc44-adea31a12df6 req-711605db-a09c-416d-a380-7ffc7ca1248a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029249 Jun 27 15:03:55.025503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 825/1075] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:03:55.482361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:55.483778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:55.490701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:55.491147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:55.491914 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:55.492351 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:55.646719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:55.654556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:55.656049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:55.657243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-41402a17-6d98-4302-b45b-af0707ebe0ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.179221 Jun 27 15:03:55.658054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 826/1076] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:03:55 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:03:55.662349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f823f601-dda9-4dca-b90a-a05ee6e78227 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:55.662941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f823f601-dda9-4dca-b90a-a05ee6e78227 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:55.668522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f823f601-dda9-4dca-b90a-a05ee6e78227 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:55.669002 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f823f601-dda9-4dca-b90a-a05ee6e78227 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:55.669754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f823f601-dda9-4dca-b90a-a05ee6e78227 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:55.670185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f823f601-dda9-4dca-b90a-a05ee6e78227 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:55.794524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f823f601-dda9-4dca-b90a-a05ee6e78227 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:55.802880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f823f601-dda9-4dca-b90a-a05ee6e78227 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1730 microversion: 2.1 time: 0.143884 Jun 27 15:03:55.803438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 827/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:55 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1730 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:55.807828 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e4f94ea4-c635-404c-9646-2185352c3bcb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:55.808719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e4f94ea4-c635-404c-9646-2185352c3bcb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:55.814986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4f94ea4-c635-404c-9646-2185352c3bcb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:55.815431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4f94ea4-c635-404c-9646-2185352c3bcb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:55.816185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4f94ea4-c635-404c-9646-2185352c3bcb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:55.816620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4f94ea4-c635-404c-9646-2185352c3bcb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:55.942932 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e4f94ea4-c635-404c-9646-2185352c3bcb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:55.950290 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e4f94ea4-c635-404c-9646-2185352c3bcb tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.145925 Jun 27 15:03:55.950848 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 828/1078] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:55 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:03:55.955240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-04dee85e-2f80-4616-84ac-2a0abfaddc78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:55.955714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-04dee85e-2f80-4616-84ac-2a0abfaddc78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:55.961306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04dee85e-2f80-4616-84ac-2a0abfaddc78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:55.961753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04dee85e-2f80-4616-84ac-2a0abfaddc78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:55.962511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04dee85e-2f80-4616-84ac-2a0abfaddc78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:55.962947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04dee85e-2f80-4616-84ac-2a0abfaddc78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:56.046594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-04dee85e-2f80-4616-84ac-2a0abfaddc78 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094683 Jun 27 15:03:56.047417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 829/1079] 10.222.0.44 () {58 vars in 1274 bytes} [Mon Jun 27 15:03:55 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:03:56.676404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:56.677150 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:56.682911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:56.683605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:56.684348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:56.684800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:56.926799 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:56.935810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:56.937329 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:56.938546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-93f9f136-d5be-46ae-a3c6-b91ec13d6bf0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.266696 Jun 27 15:03:56.939908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 830/1080] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:03:56 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:03:56.967967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-04a0a937-839e-4d2c-9ee5-9a65ac3a9467 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:56.969015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-04a0a937-839e-4d2c-9ee5-9a65ac3a9467 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:56.976993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04a0a937-839e-4d2c-9ee5-9a65ac3a9467 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:56.977996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04a0a937-839e-4d2c-9ee5-9a65ac3a9467 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:56.979041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04a0a937-839e-4d2c-9ee5-9a65ac3a9467 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:56.979696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-04a0a937-839e-4d2c-9ee5-9a65ac3a9467 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:57.309676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-04a0a937-839e-4d2c-9ee5-9a65ac3a9467 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:57.318318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-04a0a937-839e-4d2c-9ee5-9a65ac3a9467 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.355068 Jun 27 15:03:57.331121 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 831/1081] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:56 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:57.484271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-e9eee0a0-72a8-4e9d-88b7-9dcb45cbc3a3 req-9057f7cc-a85a-400d-9c8e-4dcdbf9605cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c", "tag": "059a8345-bdf4-4361-bf2e-05650504b384"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:57.494005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-e9eee0a0-72a8-4e9d-88b7-9dcb45cbc3a3 req-9057f7cc-a85a-400d-9c8e-4dcdbf9605cb service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:57.494255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-e9eee0a0-72a8-4e9d-88b7-9dcb45cbc3a3 req-9057f7cc-a85a-400d-9c8e-4dcdbf9605cb service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:57.506118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-e9eee0a0-72a8-4e9d-88b7-9dcb45cbc3a3 req-9057f7cc-a85a-400d-9c8e-4dcdbf9605cb service nova] Creating event network-changed:059a8345-bdf4-4361-bf2e-05650504b384 for instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c on hv-cinder-79760 Jun 27 15:03:57.511457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-e9eee0a0-72a8-4e9d-88b7-9dcb45cbc3a3 req-9057f7cc-a85a-400d-9c8e-4dcdbf9605cb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030663 Jun 27 15:03:57.512011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 832/1082] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:03:57.958179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:57.958869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:57.966986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:57.967429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:57.968185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:57.968810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:58.105504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:58.116284 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:58.117798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:58.118969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c65390e9-27a9-45fc-b847-322563644645 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1723 microversion: 2.20 time: 0.165774 Jun 27 15:03:58.120678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 833/1083] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:03:57 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:03:58.337831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f72b9a9d-0263-4957-a4bb-ddceb598c8dd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:58.338458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f72b9a9d-0263-4957-a4bb-ddceb598c8dd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:58.344504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f72b9a9d-0263-4957-a4bb-ddceb598c8dd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:58.345093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f72b9a9d-0263-4957-a4bb-ddceb598c8dd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:58.345993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f72b9a9d-0263-4957-a4bb-ddceb598c8dd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:58.346446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f72b9a9d-0263-4957-a4bb-ddceb598c8dd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:58.537554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f72b9a9d-0263-4957-a4bb-ddceb598c8dd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:58.553187 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f72b9a9d-0263-4957-a4bb-ddceb598c8dd tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1574 microversion: 2.1 time: 0.212997 Jun 27 15:03:58.554226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 834/1084] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:58 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:03:59.138701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:59.139360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:59.145803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:59.146257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:59.147018 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:59.147480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:59.179423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:59.180102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:59.180554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lazy-loading 'fault' on Instance uuid d67eac8a-bfba-489d-8d6d-11956e1b4e90 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:03:59.222806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:59.231136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:59.232635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:59.233827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-048e5a00-dc2f-437b-be4e-372cf394d4c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 200 len: 1371 microversion: 2.20 time: 0.099566 Jun 27 15:03:59.234395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 835/1085] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:03:59 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:03:59.530845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-21b85911-024b-48a3-ab57-875ca342cb9a req-859adecf-e1e1-4ed1-b1bb-d6d744c47bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c", "tag": "059a8345-bdf4-4361-bf2e-05650504b384"}, {"server_uuid": "d67eac8a-bfba-489d-8d6d-11956e1b4e90", "name": "network-vif-deleted", "tag": "2f2fac3d-9b57-4c4a-a63d-b53b86aca080"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:03:59.540735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-21b85911-024b-48a3-ab57-875ca342cb9a req-859adecf-e1e1-4ed1-b1bb-d6d744c47bcc service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:59.542867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-21b85911-024b-48a3-ab57-875ca342cb9a req-859adecf-e1e1-4ed1-b1bb-d6d744c47bcc service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:59.553779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-21b85911-024b-48a3-ab57-875ca342cb9a req-859adecf-e1e1-4ed1-b1bb-d6d744c47bcc service nova] Creating event network-changed:059a8345-bdf4-4361-bf2e-05650504b384 for instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c on hv-cinder-79760 Jun 27 15:03:59.554322 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-21b85911-024b-48a3-ab57-875ca342cb9a req-859adecf-e1e1-4ed1-b1bb-d6d744c47bcc service nova] Creating event network-vif-deleted:2f2fac3d-9b57-4c4a-a63d-b53b86aca080 for instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 on hv-cinder-79760 Jun 27 15:03:59.561223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-21b85911-024b-48a3-ab57-875ca342cb9a req-859adecf-e1e1-4ed1-b1bb-d6d744c47bcc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034212 Jun 27 15:03:59.561722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 836/1086] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:03:59.571073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d9512cd1-5b75-4109-ac1d-f227ff8b475d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:03:59.573876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d9512cd1-5b75-4109-ac1d-f227ff8b475d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:03:59.578595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9512cd1-5b75-4109-ac1d-f227ff8b475d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:59.579737 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9512cd1-5b75-4109-ac1d-f227ff8b475d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:59.580810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9512cd1-5b75-4109-ac1d-f227ff8b475d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:03:59.581408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9512cd1-5b75-4109-ac1d-f227ff8b475d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:03:59.585617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:59.721998 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d9512cd1-5b75-4109-ac1d-f227ff8b475d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:03:59.729635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d9512cd1-5b75-4109-ac1d-f227ff8b475d tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1561 microversion: 2.1 time: 0.162645 Jun 27 15:03:59.730227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 837/1087] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:03:59 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:04:00.253969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:00.254694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:00.262316 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:00.263140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:00.263782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:00.264339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:00.279087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] HTTP exception thrown: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Request method failure captured: Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 HTTP/1.1 Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT6E8qpbFeunhO3-eUzigTzl-EQ8nuUJ-3z2888iRcGaF8qzwpz0yaRnITkRqtNDFP8nS2r05WKAd04cbsv5Tx38-a_OSpbuokT_GrUWuuy7eCYqv9S_NhDoZxp-3TWYF9KAQqOBY0MmGCvUSTtQyiy0C9kOqD27-qWCPwm8LCegv0 Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:04:00.280986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 29e7fc2290a641bcb6f1f96501f98d69 Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:04:00.282733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'd67eac8a-bfba-489d-8d6d-11956e1b4e90'} Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:04:00.283811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:04:00.285357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:00.286722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Returning 404 to user: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:04:00.286722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-81d391c4-9be4-4449-9728-77d18d373c42 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 404 len: 111 microversion: 2.20 time: 0.035737 Jun 27 15:04:00.286722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 838/1088] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:00 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:04:00.294472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2f962a21-c0ab-4b85-99a8-bef81b1073c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '.version_select at 0x7f13f9659c10>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:00.393638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2f962a21-c0ab-4b85-99a8-bef81b1073c1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-640797940" status: 204 len: 0 microversion: 2.20 time: 0.102698 Jun 27 15:04:00.394539 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 839/1089] 10.222.0.44 () {60 vars in 1258 bytes} [Mon Jun 27 15:04:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-640797940 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 27 15:04:01.171957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8db924a8-5bc3-4c6f-82a1-e2e4b2ab82d7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'create', calling method: .version_select at 0x7f13f96e15e0>, body: {"keypair": {"name": "tempest-keypair-429814664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjweSFotw0rsPsvT5xV+dat1AXIuD/r42mk2z0mN+JC5fBfHebroxXd2c4hWpHnVH5mIPxu1WzoJlKPjKDoqUyISCl9ZhhpjCWHzJK3LF+fhuXQGNgk7rsILnQdsF5uCA=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:04:01.186810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-8db924a8-5bc3-4c6f-82a1-e2e4b2ab82d7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Getting quotas for project 93e1b27eb6724262b7a128c8412642d6. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:04:01.191264 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-8db924a8-5bc3-4c6f-82a1-e2e4b2ab82d7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Getting quotas for user 29e7fc2290a641bcb6f1f96501f98d69 and project 93e1b27eb6724262b7a128c8412642d6. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:04:01.294466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8db924a8-5bc3-4c6f-82a1-e2e4b2ab82d7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.126402 Jun 27 15:04:01.295067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 840/1090] 10.222.0.44 () {62 vars in 1199 bytes} [Mon Jun 27 15:04:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 27 15:04:03.481116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1879058484", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc63a8c7-0e5b-4561-8e04-9bbfbecdaeb8"}], "security_groups": [{"name": "tempest-securitygroup--934722305"}], "key_name": "tempest-keypair-429814664", "user_data": "}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:04:03.578830 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] validate_networks() for [('cc63a8c7-0e5b-4561-8e04-9bbfbecdaeb8', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:04:03.944098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:04:03.944524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:04:03.945013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:04:03.945416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:04:03.945823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:04:03.955188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:03.955626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:03.956413 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:03.956885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:03.975462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Getting quotas for project 93e1b27eb6724262b7a128c8412642d6. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:04:03.979335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Getting quotas for user 29e7fc2290a641bcb6f1f96501f98d69 and project 93e1b27eb6724262b7a128c8412642d6. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:04:03.990135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:04:03.992336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:04:04.123883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fa7fa033-b9ea-465d-a487-8ff9809296b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.647743 Jun 27 15:04:04.124523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 841/1091] 10.222.0.44 () {62 vars in 1187 bytes} [Mon Jun 27 15:04:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 27 15:04:04.134507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5b1bad29-574c-4ba3-85e8-9b31db45af51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:04.135107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5b1bad29-574c-4ba3-85e8-9b31db45af51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:04.190152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5b1bad29-574c-4ba3-85e8-9b31db45af51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:04.197406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5b1bad29-574c-4ba3-85e8-9b31db45af51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:04.198896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5b1bad29-574c-4ba3-85e8-9b31db45af51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:04.199986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5b1bad29-574c-4ba3-85e8-9b31db45af51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1281 microversion: 2.20 time: 0.069333 Jun 27 15:04:04.200563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 842/1092] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:04 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:05.218365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:05.219024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:05.226543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:05.226979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:05.227723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:05.228149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:05.294151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:05.302810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:05.304300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:05.305408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-aa199d0a-c8ed-4088-a766-3f60dbed477c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1277 microversion: 2.20 time: 0.091060 Jun 27 15:04:05.305959 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 843/1093] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:05 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:06.325353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:06.326023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:06.332591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:06.333088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:06.333831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:06.334259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:06.397120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:06.404908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:06.406918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:06.408074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c63a64f9-2f42-40c9-9728-c36cdcd3f324 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1351 microversion: 2.20 time: 0.086005 Jun 27 15:04:06.408620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 844/1094] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:06 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:07.426705 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:07.427408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:07.430780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:04:07.434554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:07.441525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:07.441525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:07.441525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:07.565403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:07.573689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:07.575245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:07.576451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3f9e8100-49cf-42c1-a85a-ac9c21a8e696 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1406 microversion: 2.20 time: 0.154396 Jun 27 15:04:07.580900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 845/1095] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:07 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:07.860347 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-e9e0a119-b067-48b0-bac0-9e77c77bf439 req-6e643e00-7b50-4d27-b6b1-36eb2b10cf93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d41a61-4384-417c-8b5e-8ddd12ccf67a", "tag": "bef0c110-529a-43f2-91a5-47a11127e1ad"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:04:07.868977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-e9e0a119-b067-48b0-bac0-9e77c77bf439 req-6e643e00-7b50-4d27-b6b1-36eb2b10cf93 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:07.869257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-e9e0a119-b067-48b0-bac0-9e77c77bf439 req-6e643e00-7b50-4d27-b6b1-36eb2b10cf93 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:07.880672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-e9e0a119-b067-48b0-bac0-9e77c77bf439 req-6e643e00-7b50-4d27-b6b1-36eb2b10cf93 service nova] Creating event network-changed:bef0c110-529a-43f2-91a5-47a11127e1ad for instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a on hv-cinder-79760 Jun 27 15:04:07.885817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-e9e0a119-b067-48b0-bac0-9e77c77bf439 req-6e643e00-7b50-4d27-b6b1-36eb2b10cf93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029546 Jun 27 15:04:07.886636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 846/1096] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:04:08.597436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:08.598243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:08.605113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:08.605557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:08.606304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:08.606734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:08.740426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:08.748543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:08.750067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:08.751889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b4edab2b-f3d8-4e77-819b-3485590b1bab tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1406 microversion: 2.20 time: 0.160135 Jun 27 15:04:08.752448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 847/1097] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:08 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:09.770093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:09.770765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:09.777078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:09.777519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:09.778259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:09.778684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:09.904543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:09.913011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:09.914498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:09.915575 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5550ec12-f42a-44a7-b049-5685339f2998 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1406 microversion: 2.20 time: 0.149868 Jun 27 15:04:09.916118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 848/1098] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:09 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:10.934211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:10.934864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:10.942026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:10.942465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:10.943211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:10.943638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:11.075330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:11.083364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:11.084896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:11.086019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0e14cae4-bcd3-4a69-a0fa-e1528b812778 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1406 microversion: 2.20 time: 0.156282 Jun 27 15:04:11.086634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 849/1099] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:10 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:12.103490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:12.104131 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:12.110919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:12.111400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:12.112166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:12.112605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:12.244175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:12.252697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:12.256240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:12.256240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a25805ac-abd0-4094-a2ed-10cacd817043 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1406 microversion: 2.20 time: 0.155894 Jun 27 15:04:12.256240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 850/1100] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:12 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:13.253637 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-7955dbc5-ff82-4d39-ae8f-7edfd63931cd req-c67a9b5f-f333-45cb-a831-f4e6c449753c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d41a61-4384-417c-8b5e-8ddd12ccf67a", "name": "network-vif-plugged", "status": "completed", "tag": "bef0c110-529a-43f2-91a5-47a11127e1ad"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:04:13.262015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-7955dbc5-ff82-4d39-ae8f-7edfd63931cd req-c67a9b5f-f333-45cb-a831-f4e6c449753c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:13.262456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-7955dbc5-ff82-4d39-ae8f-7edfd63931cd req-c67a9b5f-f333-45cb-a831-f4e6c449753c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:13.273930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-7955dbc5-ff82-4d39-ae8f-7edfd63931cd req-c67a9b5f-f333-45cb-a831-f4e6c449753c service nova] Creating event network-vif-plugged:bef0c110-529a-43f2-91a5-47a11127e1ad for instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a on hv-cinder-79760 Jun 27 15:04:13.278647 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-7955dbc5-ff82-4d39-ae8f-7edfd63931cd req-c67a9b5f-f333-45cb-a831-f4e6c449753c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028926 Jun 27 15:04:13.279207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 851/1101] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:04:13.284728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:13.285409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:13.291314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:13.291758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:13.292598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:13.293061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:13.429671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:13.437909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:13.439749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:13.440927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-78404fcf-5eda-4dbe-a6ee-746c71ef7eaf tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1406 microversion: 2.20 time: 0.160597 Jun 27 15:04:13.441488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 852/1102] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:13 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:04:14.458540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:14.459148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:14.461094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:04:14.461773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=12 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:04:14.466964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:14.467408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:14.468160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:14.468593 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:14.602988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:14.611986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:14.613502 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:14.614653 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-505af8f5-909a-4861-80bf-6384244b4cac tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1406 microversion: 2.20 time: 0.160024 Jun 27 15:04:14.615198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 853/1103] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:14 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:15.631869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:15.632549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:15.638962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:15.639400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:15.640141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:15.640567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:15.767659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:15.775516 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:15.777097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:15.778245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-596825fa-ac7f-43be-8ac6-4bd873533019 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1597 microversion: 2.20 time: 0.150262 Jun 27 15:04:15.778796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 854/1104] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:04:15 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1597 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:04:15.795639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3d0a20de-86dd-4c0a-abd5-4caad318efa3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:15.796115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3d0a20de-86dd-4c0a-abd5-4caad318efa3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:15.801921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3d0a20de-86dd-4c0a-abd5-4caad318efa3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:15.802358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3d0a20de-86dd-4c0a-abd5-4caad318efa3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:15.803100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3d0a20de-86dd-4c0a-abd5-4caad318efa3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:15.803523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3d0a20de-86dd-4c0a-abd5-4caad318efa3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:15.878901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3d0a20de-86dd-4c0a-abd5-4caad318efa3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086908 Jun 27 15:04:15.879506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 855/1105] 10.222.0.44 () {60 vars in 1315 bytes} [Mon Jun 27 15:04:15 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:04:16.857995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-f0f9dbec-1c97-4d73-b7e2-6d1b364aad20 req-6d999d16-77dc-4f75-bcc7-fea2e93085b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d41a61-4384-417c-8b5e-8ddd12ccf67a", "tag": "bef0c110-529a-43f2-91a5-47a11127e1ad"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:04:16.869664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f0f9dbec-1c97-4d73-b7e2-6d1b364aad20 req-6d999d16-77dc-4f75-bcc7-fea2e93085b0 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:16.870272 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f0f9dbec-1c97-4d73-b7e2-6d1b364aad20 req-6d999d16-77dc-4f75-bcc7-fea2e93085b0 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:16.882444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-f0f9dbec-1c97-4d73-b7e2-6d1b364aad20 req-6d999d16-77dc-4f75-bcc7-fea2e93085b0 service nova] Creating event network-changed:bef0c110-529a-43f2-91a5-47a11127e1ad for instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a on hv-cinder-79760 Jun 27 15:04:16.887316 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-f0f9dbec-1c97-4d73-b7e2-6d1b364aad20 req-6d999d16-77dc-4f75-bcc7-fea2e93085b0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035064 Jun 27 15:04:16.887910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 856/1106] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:04:53.239179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=22 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:04:53.239934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=78 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:04:53.244383 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c6070e94-5061-4421-8a85-ff7298eda679 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-859754205"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:04:53.245037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c6070e94-5061-4421-8a85-ff7298eda679 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:53.251060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6070e94-5061-4421-8a85-ff7298eda679 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:53.256480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6070e94-5061-4421-8a85-ff7298eda679 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:53.256480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6070e94-5061-4421-8a85-ff7298eda679 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:53.256480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c6070e94-5061-4421-8a85-ff7298eda679 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:53.384714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.network.security_group_api [None req-c6070e94-5061-4421-8a85-ff7298eda679 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Removing security group cac1aae4-34fe-435d-8bab-7a33fc145dc6 from port 53878d21-1d99-4fed-a685-f691228ebaa2 Jun 27 15:04:53.803257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c6070e94-5061-4421-8a85-ff7298eda679 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "POST /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/action" status: 202 len: 0 microversion: 2.1 time: 0.565108 Jun 27 15:04:53.807450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 857/1107] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:04:53 2022] POST /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:04:53.819405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-aea327e1-255d-4166-aaea-6ae4903afce0 req-26d6010b-da08-4ba7-b819-caf95781d039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f21014-5688-42b2-990a-51b99ff11e91", "tag": "53878d21-1d99-4fed-a685-f691228ebaa2"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:04:53.839533 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-aea327e1-255d-4166-aaea-6ae4903afce0 req-26d6010b-da08-4ba7-b819-caf95781d039 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:53.840015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-aea327e1-255d-4166-aaea-6ae4903afce0 req-26d6010b-da08-4ba7-b819-caf95781d039 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:53.863458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-aea327e1-255d-4166-aaea-6ae4903afce0 req-26d6010b-da08-4ba7-b819-caf95781d039 service nova] Creating event network-changed:53878d21-1d99-4fed-a685-f691228ebaa2 for instance c2f21014-5688-42b2-990a-51b99ff11e91 on hv-cinder-79760 Jun 27 15:04:53.870285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-aea327e1-255d-4166-aaea-6ae4903afce0 req-26d6010b-da08-4ba7-b819-caf95781d039 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055464 Jun 27 15:04:53.871618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 858/1108] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:04:55.083890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6267a088-d708-4660-9391-28d2c3724773 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:55.084792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6267a088-d708-4660-9391-28d2c3724773 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:55.091739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6267a088-d708-4660-9391-28d2c3724773 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:55.092258 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6267a088-d708-4660-9391-28d2c3724773 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:55.093115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6267a088-d708-4660-9391-28d2c3724773 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:55.093609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6267a088-d708-4660-9391-28d2c3724773 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:55.175349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-6267a088-d708-4660-9391-28d2c3724773 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lazy-loading 'services' on Instance uuid c2f21014-5688-42b2-990a-51b99ff11e91 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:04:55.344903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6267a088-d708-4660-9391-28d2c3724773 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments/aa108b6f-9bb1-4134-84ab-f99c013d238f" status: 202 len: 0 microversion: 2.1 time: 0.265091 Jun 27 15:04:55.345600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 859/1109] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:04:55 2022] DELETE /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments/aa108b6f-9bb1-4134-84ab-f99c013d238f => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:04:55.354366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-17104896-0824-455b-b3bc-a672266e0577 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:55.355466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-17104896-0824-455b-b3bc-a672266e0577 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:55.361844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17104896-0824-455b-b3bc-a672266e0577 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:55.362393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17104896-0824-455b-b3bc-a672266e0577 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:55.363249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17104896-0824-455b-b3bc-a672266e0577 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:55.363753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17104896-0824-455b-b3bc-a672266e0577 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:55.394223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-17104896-0824-455b-b3bc-a672266e0577 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Jun 27 15:04:55.394824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 860/1110] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:04:55 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:04:55.885622 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-f6cdb7ba-b0ac-4223-b06b-895e42175758 req-be1c9684-2653-458e-aeed-3fe0a3149af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f21014-5688-42b2-990a-51b99ff11e91", "tag": "53878d21-1d99-4fed-a685-f691228ebaa2"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:04:55.893485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f6cdb7ba-b0ac-4223-b06b-895e42175758 req-be1c9684-2653-458e-aeed-3fe0a3149af8 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:55.893922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f6cdb7ba-b0ac-4223-b06b-895e42175758 req-be1c9684-2653-458e-aeed-3fe0a3149af8 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:55.905379 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-f6cdb7ba-b0ac-4223-b06b-895e42175758 req-be1c9684-2653-458e-aeed-3fe0a3149af8 service nova] Creating event network-changed:53878d21-1d99-4fed-a685-f691228ebaa2 for instance c2f21014-5688-42b2-990a-51b99ff11e91 on hv-cinder-79760 Jun 27 15:04:55.910441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-f6cdb7ba-b0ac-4223-b06b-895e42175758 req-be1c9684-2653-458e-aeed-3fe0a3149af8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028873 Jun 27 15:04:55.911023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 861/1111] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:04:56.406082 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5966f2f3-aad5-4df1-bcbf-35f35984b3c3 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:56.407116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5966f2f3-aad5-4df1-bcbf-35f35984b3c3 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:56.414248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5966f2f3-aad5-4df1-bcbf-35f35984b3c3 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:56.414700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5966f2f3-aad5-4df1-bcbf-35f35984b3c3 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:56.415454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5966f2f3-aad5-4df1-bcbf-35f35984b3c3 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:56.415887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5966f2f3-aad5-4df1-bcbf-35f35984b3c3 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:56.444979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5966f2f3-aad5-4df1-bcbf-35f35984b3c3 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 Jun 27 15:04:56.445532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 862/1112] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:04:56 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:04:57.456721 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3ac0a136-6560-48d7-8fb2-80875073eb62 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:57.457630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3ac0a136-6560-48d7-8fb2-80875073eb62 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:57.464146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ac0a136-6560-48d7-8fb2-80875073eb62 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:57.468117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ac0a136-6560-48d7-8fb2-80875073eb62 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:57.468117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ac0a136-6560-48d7-8fb2-80875073eb62 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:57.468117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3ac0a136-6560-48d7-8fb2-80875073eb62 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:57.493843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3ac0a136-6560-48d7-8fb2-80875073eb62 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041066 Jun 27 15:04:57.494386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 863/1113] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:04:57 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:04:57.503500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:57.503979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:57.510517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:57.510955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:57.511694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:57.512120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:57.586074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] HTTP exception thrown: Instance c2f21014-5688-42b2-990a-51b99ff11e91 is not attached to volume aa108b6f-9bb1-4134-84ab-f99c013d238f Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Request method failure captured: Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments/aa108b6f-9bb1-4134-84ab-f99c013d238f HTTP/1.1 Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucX79lm6EqPkTlOKBVuTLpm9PKKCDcVS-rAH9cEiQl2JnyQ5hzoqaTM4yTcQ0BhZ3TonP0e2RjbxGu36lIjHA5BXLMwIaQ_HnTKkeRV_BpCt8v9BkdM7YNHvFfbkZlVN9NgwDzDjEwiFOV3AQKuuw85XNuZ1LoirNd1AZULpfj4mnbc Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 51e6f52c6a854f65aaa7f0a3f706c83c Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-TestMinimumBasicScenario-1206421790 Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:04:57.590532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_51e6f52c6a854f65aaa7f0a3f706c83c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/51e6f52c6a854f65aaa7f0a3f706c83c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/51e6f52c6a854f65aaa7f0a3f706c83c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/51e6f52c6a854f65aaa7f0a3f706c83c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-TestMinimumBasicScenario-1206421790 Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 51e6f52c6a854f65aaa7f0a3f706c83c Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1206421790 Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-TestMinimumBasicScenario-1206421790-project Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: e03bcfa7f95d4266ac02a457e14d0c01 Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-TestMinimumBasicScenario-1206421790-project Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:04:57.592152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance c2f21014-5688-42b2-990a-51b99ff11e91 is not attached to volume aa108b6f-9bb1-4134-84ab-f99c013d238f Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'server_id': 'c2f21014-5688-42b2-990a-51b99ff11e91', 'id': 'aa108b6f-9bb1-4134-84ab-f99c013d238f'} Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id aa108b6f-9bb1-4134-84ab-f99c013d238f. Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:04:57.593183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f21014-5688-42b2-990a-51b99ff11e91 is not attached to volume aa108b6f-9bb1-4134-84ab-f99c013d238f Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f21014-5688-42b2-990a-51b99ff11e91 is not attached to volume aa108b6f-9bb1-4134-84ab-f99c013d238f Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:04:57.594662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Returning 404 to user: Instance c2f21014-5688-42b2-990a-51b99ff11e91 is not attached to volume aa108b6f-9bb1-4134-84ab-f99c013d238f {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:04:57.596146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0c1e9f20-eb32-4c24-91ea-7558f8f47fdb tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments/aa108b6f-9bb1-4134-84ab-f99c013d238f" status: 404 len: 154 microversion: 2.1 time: 0.092042 Jun 27 15:04:57.596146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 864/1114] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:04:57 2022] DELETE /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91/os-volume_attachments/aa108b6f-9bb1-4134-84ab-f99c013d238f => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:04:58.868984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e8c9adb9-15ac-4b98-a6d2-aa98a39b95e5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:58.869510 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e8c9adb9-15ac-4b98-a6d2-aa98a39b95e5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:58.875845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8c9adb9-15ac-4b98-a6d2-aa98a39b95e5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:58.876285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8c9adb9-15ac-4b98-a6d2-aa98a39b95e5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:58.877065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8c9adb9-15ac-4b98-a6d2-aa98a39b95e5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:58.877498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8c9adb9-15ac-4b98-a6d2-aa98a39b95e5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:58.902425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e8c9adb9-15ac-4b98-a6d2-aa98a39b95e5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:04:59.151171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e8c9adb9-15ac-4b98-a6d2-aa98a39b95e5 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 204 len: 0 microversion: 2.1 time: 0.286530 Jun 27 15:04:59.151844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 865/1115] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:04:58 2022] DELETE /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:04:59.161712 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7ca93221-e794-4ea0-afa3-7e7534e1bad7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:04:59.162395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7ca93221-e794-4ea0-afa3-7e7534e1bad7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:04:59.169052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ca93221-e794-4ea0-afa3-7e7534e1bad7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:59.169493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ca93221-e794-4ea0-afa3-7e7534e1bad7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:59.170234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ca93221-e794-4ea0-afa3-7e7534e1bad7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:04:59.170664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7ca93221-e794-4ea0-afa3-7e7534e1bad7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:04:59.305972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7ca93221-e794-4ea0-afa3-7e7534e1bad7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:04:59.313598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7ca93221-e794-4ea0-afa3-7e7534e1bad7 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1556 microversion: 2.1 time: 0.157160 Jun 27 15:04:59.314163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 866/1116] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:04:59 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:00.330926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b699a30f-e04c-45e2-af88-8942d84cd66c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:00.331585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b699a30f-e04c-45e2-af88-8942d84cd66c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:00.338505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b699a30f-e04c-45e2-af88-8942d84cd66c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:00.338951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b699a30f-e04c-45e2-af88-8942d84cd66c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:00.339702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b699a30f-e04c-45e2-af88-8942d84cd66c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:00.340140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b699a30f-e04c-45e2-af88-8942d84cd66c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:00.467600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b699a30f-e04c-45e2-af88-8942d84cd66c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:00.475114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b699a30f-e04c-45e2-af88-8942d84cd66c tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1556 microversion: 2.1 time: 0.148107 Jun 27 15:05:00.475662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 867/1117] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:00 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:01.493506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-93edd026-2815-4d97-8b62-1b9db91433c2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:01.494245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-93edd026-2815-4d97-8b62-1b9db91433c2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:01.500439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93edd026-2815-4d97-8b62-1b9db91433c2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:01.500915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93edd026-2815-4d97-8b62-1b9db91433c2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:01.501690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93edd026-2815-4d97-8b62-1b9db91433c2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:01.502134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93edd026-2815-4d97-8b62-1b9db91433c2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:01.634012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-93edd026-2815-4d97-8b62-1b9db91433c2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:01.641545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-93edd026-2815-4d97-8b62-1b9db91433c2 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1556 microversion: 2.1 time: 0.152668 Jun 27 15:05:01.642103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 868/1118] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:01 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:02.077610 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-abd60ec6-ae5e-43e3-9d87-549c9fa4a105 req-774a2164-9445-409e-b951-d75a854df900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f21014-5688-42b2-990a-51b99ff11e91", "name": "network-vif-deleted", "tag": "53878d21-1d99-4fed-a685-f691228ebaa2"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:02.086224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-abd60ec6-ae5e-43e3-9d87-549c9fa4a105 req-774a2164-9445-409e-b951-d75a854df900 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:02.086662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-abd60ec6-ae5e-43e3-9d87-549c9fa4a105 req-774a2164-9445-409e-b951-d75a854df900 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:02.098283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-abd60ec6-ae5e-43e3-9d87-549c9fa4a105 req-774a2164-9445-409e-b951-d75a854df900 service nova] Creating event network-vif-deleted:53878d21-1d99-4fed-a685-f691228ebaa2 for instance c2f21014-5688-42b2-990a-51b99ff11e91 on hv-cinder-79760 Jun 27 15:05:02.103944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-abd60ec6-ae5e-43e3-9d87-549c9fa4a105 req-774a2164-9445-409e-b951-d75a854df900 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030073 Jun 27 15:05:02.104543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 869/1119] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:05:02.659457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:02.660151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:02.666483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:02.666929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:02.667675 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:02.668132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:02.699407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:02.701669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:02.701669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lazy-loading 'fault' on Instance uuid c2f21014-5688-42b2-990a-51b99ff11e91 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:05:02.744439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03bcfa7f95d4266ac02a457e14d0c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e6f52c6a854f65aaa7f0a3f706c83c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:02.751981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cbf52ecd-6c63-4bf9-873b-eea0e762e511 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 200 len: 1349 microversion: 2.1 time: 0.097263 Jun 27 15:05:02.752544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 870/1120] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:02 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:03.769552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:03.770258 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] [instance: c2f21014-5688-42b2-990a-51b99ff11e91] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:03.777245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:03.777684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:03.778428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:03.778849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:03.792270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] HTTP exception thrown: Instance c2f21014-5688-42b2-990a-51b99ff11e91 could not be found. Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Request method failure captured: Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 HTTP/1.1 Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucX79lm6EqPkTlOKBVuTLpm9PKKCDcVS-rAH9cEiQl2JnyQ5hzoqaTM4yTcQ0BhZ3TonP0e2RjbxGu36lIjHA5BXLMwIaQ_HnTKkeRV_BpCt8v9BkdM7YNHvFfbkZlVN9NgwDzDjEwiFOV3AQKuuw85XNuZ1LoirNd1AZULpfj4mnbc Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 51e6f52c6a854f65aaa7f0a3f706c83c Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-TestMinimumBasicScenario-1206421790 Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:03.793915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_51e6f52c6a854f65aaa7f0a3f706c83c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/51e6f52c6a854f65aaa7f0a3f706c83c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/51e6f52c6a854f65aaa7f0a3f706c83c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/51e6f52c6a854f65aaa7f0a3f706c83c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-TestMinimumBasicScenario-1206421790 Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 51e6f52c6a854f65aaa7f0a3f706c83c Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1206421790 Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-TestMinimumBasicScenario-1206421790-project Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: e03bcfa7f95d4266ac02a457e14d0c01 Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-TestMinimumBasicScenario-1206421790-project Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance c2f21014-5688-42b2-990a-51b99ff11e91 could not be found. Jun 27 15:05:03.795514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'c2f21014-5688-42b2-990a-51b99ff11e91'} Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f21014-5688-42b2-990a-51b99ff11e91 could not be found. Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:03.796291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f21014-5688-42b2-990a-51b99ff11e91 could not be found. Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f21014-5688-42b2-990a-51b99ff11e91 could not be found. Jun 27 15:05:03.797558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:03.798716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Returning 404 to user: Instance c2f21014-5688-42b2-990a-51b99ff11e91 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:03.798716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-588f71d9-2338-48e5-8538-787b0f178829 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91" status: 404 len: 111 microversion: 2.1 time: 0.029603 Jun 27 15:05:03.798716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 871/1121] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:03 2022] GET /compute/v2.1/servers/c2f21014-5688-42b2-990a-51b99ff11e91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:05:03.803290 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-30e31005-5fd9-41fb-88cb-956020101205 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] Calling method '.version_select at 0x7f13f95ce430>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:03.866205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-30e31005-5fd9-41fb-88cb-956020101205 tempest-TestMinimumBasicScenario-1206421790 tempest-TestMinimumBasicScenario-1206421790-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1787073673" status: 202 len: 0 microversion: 2.1 time: 0.066266 Jun 27 15:05:03.867141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 872/1122] 10.222.0.44 () {58 vars in 1271 bytes} [Mon Jun 27 15:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1787073673 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:05:03.955649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0107f7a8-a006-4907-8b7e-f3e5bdf62569 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:03.956133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0107f7a8-a006-4907-8b7e-f3e5bdf62569 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:03.962806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0107f7a8-a006-4907-8b7e-f3e5bdf62569 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:03.963245 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0107f7a8-a006-4907-8b7e-f3e5bdf62569 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:03.963997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0107f7a8-a006-4907-8b7e-f3e5bdf62569 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:03.964422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0107f7a8-a006-4907-8b7e-f3e5bdf62569 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:04.044576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-0107f7a8-a006-4907-8b7e-f3e5bdf62569 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lazy-loading 'services' on Instance uuid 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:05:04.242336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0107f7a8-a006-4907-8b7e-f3e5bdf62569 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments/bc83b666-9d20-47cd-ab45-3b85e30edac6" status: 202 len: 0 microversion: 2.1 time: 0.289837 Jun 27 15:05:04.247766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 873/1123] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:05:03 2022] DELETE /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments/bc83b666-9d20-47cd-ab45-3b85e30edac6 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:05:04.251649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7f1ece56-65ee-4331-a2be-af3c2404997e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:04.252743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7f1ece56-65ee-4331-a2be-af3c2404997e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:04.262164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7f1ece56-65ee-4331-a2be-af3c2404997e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:04.262609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7f1ece56-65ee-4331-a2be-af3c2404997e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:04.263430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7f1ece56-65ee-4331-a2be-af3c2404997e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:04.263852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7f1ece56-65ee-4331-a2be-af3c2404997e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:04.267650 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:04.292299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7f1ece56-65ee-4331-a2be-af3c2404997e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Jun 27 15:05:04.292818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 874/1124] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:05:04 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:05:05.304893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1a59c436-fcf9-461a-aff6-108631055819 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:05.309488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1a59c436-fcf9-461a-aff6-108631055819 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:05.313827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a59c436-fcf9-461a-aff6-108631055819 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:05.314337 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a59c436-fcf9-461a-aff6-108631055819 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:05.315139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a59c436-fcf9-461a-aff6-108631055819 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:05.315610 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a59c436-fcf9-461a-aff6-108631055819 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:05.346823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1a59c436-fcf9-461a-aff6-108631055819 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046726 Jun 27 15:05:05.347668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 875/1125] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:05:05 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:05:06.359473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-dcd5d704-ac2b-4aa7-b6ed-56e28e31f05a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:06.360382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-dcd5d704-ac2b-4aa7-b6ed-56e28e31f05a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:06.367327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dcd5d704-ac2b-4aa7-b6ed-56e28e31f05a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:06.368175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dcd5d704-ac2b-4aa7-b6ed-56e28e31f05a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:06.368984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dcd5d704-ac2b-4aa7-b6ed-56e28e31f05a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:06.369593 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-dcd5d704-ac2b-4aa7-b6ed-56e28e31f05a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:06.401009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-dcd5d704-ac2b-4aa7-b6ed-56e28e31f05a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045759 Jun 27 15:05:06.401598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 876/1126] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:05:06 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:05:06.474233 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0151e183-2e7e-49f0-b6e6-3f80d9f3b88d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:06.474796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0151e183-2e7e-49f0-b6e6-3f80d9f3b88d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:06.482977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0151e183-2e7e-49f0-b6e6-3f80d9f3b88d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:06.483904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0151e183-2e7e-49f0-b6e6-3f80d9f3b88d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:06.484949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0151e183-2e7e-49f0-b6e6-3f80d9f3b88d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:06.485549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0151e183-2e7e-49f0-b6e6-3f80d9f3b88d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:06.513878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0151e183-2e7e-49f0-b6e6-3f80d9f3b88d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:05:06.807535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0151e183-2e7e-49f0-b6e6-3f80d9f3b88d tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 204 len: 0 microversion: 2.1 time: 0.337003 Jun 27 15:05:06.808331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 877/1127] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:05:06 2022] DELETE /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:05:06.816601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9c0f0394-1088-4dc7-8d84-8bcb3334c409 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:06.817782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9c0f0394-1088-4dc7-8d84-8bcb3334c409 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:06.824054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c0f0394-1088-4dc7-8d84-8bcb3334c409 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:06.825515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c0f0394-1088-4dc7-8d84-8bcb3334c409 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:06.827220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c0f0394-1088-4dc7-8d84-8bcb3334c409 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:06.827220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c0f0394-1088-4dc7-8d84-8bcb3334c409 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:06.994950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9c0f0394-1088-4dc7-8d84-8bcb3334c409 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:07.003405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9c0f0394-1088-4dc7-8d84-8bcb3334c409 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1690 microversion: 2.1 time: 0.190927 Jun 27 15:05:07.004166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 878/1128] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:06 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:08.020485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-de969b79-cf88-497d-95a0-d2b3bb8bd43a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:08.021164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-de969b79-cf88-497d-95a0-d2b3bb8bd43a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:08.027434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de969b79-cf88-497d-95a0-d2b3bb8bd43a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:08.027888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de969b79-cf88-497d-95a0-d2b3bb8bd43a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:08.028631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de969b79-cf88-497d-95a0-d2b3bb8bd43a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:08.029081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de969b79-cf88-497d-95a0-d2b3bb8bd43a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:08.185811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-de969b79-cf88-497d-95a0-d2b3bb8bd43a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:08.194219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-de969b79-cf88-497d-95a0-d2b3bb8bd43a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1690 microversion: 2.1 time: 0.177653 Jun 27 15:05:08.197836 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 879/1129] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:08 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:09.215121 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-31b0878d-b32f-4143-afb9-bbb0819b42f0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:09.215768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-31b0878d-b32f-4143-afb9-bbb0819b42f0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:09.222336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-31b0878d-b32f-4143-afb9-bbb0819b42f0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:09.222772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-31b0878d-b32f-4143-afb9-bbb0819b42f0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:09.223518 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-31b0878d-b32f-4143-afb9-bbb0819b42f0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:09.223946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-31b0878d-b32f-4143-afb9-bbb0819b42f0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:09.352628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-31b0878d-b32f-4143-afb9-bbb0819b42f0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:09.360484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-31b0878d-b32f-4143-afb9-bbb0819b42f0 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1690 microversion: 2.1 time: 0.149221 Jun 27 15:05:09.361156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 880/1130] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:09 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:10.378611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7c55ed8d-f71b-4c91-aa8a-412e8366aa8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:10.379311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7c55ed8d-f71b-4c91-aa8a-412e8366aa8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:10.385672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7c55ed8d-f71b-4c91-aa8a-412e8366aa8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:10.386116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7c55ed8d-f71b-4c91-aa8a-412e8366aa8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:10.386865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7c55ed8d-f71b-4c91-aa8a-412e8366aa8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:10.387293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7c55ed8d-f71b-4c91-aa8a-412e8366aa8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:10.528158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7c55ed8d-f71b-4c91-aa8a-412e8366aa8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:10.536482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7c55ed8d-f71b-4c91-aa8a-412e8366aa8a tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1690 microversion: 2.1 time: 0.161760 Jun 27 15:05:10.537075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 881/1131] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:10 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:11.556451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-403c5c57-09ec-4513-a68f-aa61ef159c9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:11.558181 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-403c5c57-09ec-4513-a68f-aa61ef159c9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:11.565557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-403c5c57-09ec-4513-a68f-aa61ef159c9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:11.566212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-403c5c57-09ec-4513-a68f-aa61ef159c9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:11.568057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-403c5c57-09ec-4513-a68f-aa61ef159c9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:11.568758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-403c5c57-09ec-4513-a68f-aa61ef159c9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:11.706899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-403c5c57-09ec-4513-a68f-aa61ef159c9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:11.715414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-403c5c57-09ec-4513-a68f-aa61ef159c9e tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1690 microversion: 2.1 time: 0.163059 Jun 27 15:05:11.716353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 882/1132] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:11 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:12.237422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-b0170e5e-5d49-45f8-afe5-1ee180850b17 req-08dc9829-f942-4301-91ef-1b376a6c49ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c", "name": "network-vif-deleted", "tag": "059a8345-bdf4-4361-bf2e-05650504b384"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:12.258372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-b0170e5e-5d49-45f8-afe5-1ee180850b17 req-08dc9829-f942-4301-91ef-1b376a6c49ab service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:12.259085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-b0170e5e-5d49-45f8-afe5-1ee180850b17 req-08dc9829-f942-4301-91ef-1b376a6c49ab service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:12.272031 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-b0170e5e-5d49-45f8-afe5-1ee180850b17 req-08dc9829-f942-4301-91ef-1b376a6c49ab service nova] Creating event network-vif-deleted:059a8345-bdf4-4361-bf2e-05650504b384 for instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c on hv-cinder-79760 Jun 27 15:05:12.278433 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-b0170e5e-5d49-45f8-afe5-1ee180850b17 req-08dc9829-f942-4301-91ef-1b376a6c49ab service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053650 Jun 27 15:05:12.279033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 883/1133] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:05:12.733476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:12.741190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:12.742616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:12.743305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:12.744246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:12.744874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:12.799214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:12.800275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:12.800963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lazy-loading 'fault' on Instance uuid 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:05:12.860265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:12.868758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-20b02ecd-9f50-46ab-ac2c-49ddfcb6a972 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 200 len: 1335 microversion: 2.1 time: 0.139535 Jun 27 15:05:12.869742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 884/1134] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:12 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 1335 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:13.886012 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:13.886672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:13.893340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:13.893780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:13.894523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:13.894948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:13.909279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] HTTP exception thrown: Instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c could not be found. Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Request method failure captured: Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c HTTP/1.1 Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT-38-AhZx4ML0BgmtKnzrQGmAeYhVKp5jKaqxQFcQnA7Kr9cre3Cu91khx_2JaOxjv9r1Z9kio4dNU5xXRpzSPMGfJKKbnGnmOtztAdqgT6r_4hXcpZK59VXJPjHLS4pE-eo4l84UTzV0RLVRBOIDSf2e9NbVw6MW1nFAV0jqhI38 Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:13.910894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 27b0e2428571450ea1d5edfd1c3b0f80 Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c could not be found. Jun 27 15:05:13.912543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c'} Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c could not be found. Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:13.914381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c could not be found. Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c could not be found. Jun 27 15:05:13.915870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:13.917151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Returning 404 to user: Instance 7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:13.917151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e20acbab-ad37-425b-97af-7a3f8d847eee tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c" status: 404 len: 111 microversion: 2.1 time: 0.030350 Jun 27 15:05:13.917151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 885/1135] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:13 2022] GET /compute/v2.1/servers/7fa00a00-e84e-48a7-b1e0-ee3fb85ede0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:05:13.921334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a0205872-41c2-4cc8-9237-a8481fcd4602 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '.version_select at 0x7f13f95c8430>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:14.065171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a0205872-41c2-4cc8-9237-a8481fcd4602 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843497937" status: 202 len: 0 microversion: 2.1 time: 0.147343 Jun 27 15:05:14.066184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 886/1136] 10.222.0.44 () {58 vars in 1220 bytes} [Mon Jun 27 15:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843497937 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:05:17.357435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-61a720ce-211e-4492-82d9-6bd02fb42709 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:17.358104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-61a720ce-211e-4492-82d9-6bd02fb42709 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:17.364838 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61a720ce-211e-4492-82d9-6bd02fb42709 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:17.365538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61a720ce-211e-4492-82d9-6bd02fb42709 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:17.366335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61a720ce-211e-4492-82d9-6bd02fb42709 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:17.366778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-61a720ce-211e-4492-82d9-6bd02fb42709 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:17.393498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-61a720ce-211e-4492-82d9-6bd02fb42709 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:05:17.723038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-61a720ce-211e-4492-82d9-6bd02fb42709 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 204 len: 0 microversion: 2.1 time: 0.369402 Jun 27 15:05:17.724250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 887/1137] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:05:17 2022] DELETE /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:05:17.734907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-107e593d-9c44-49b3-8599-31494a91966b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:17.735898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-107e593d-9c44-49b3-8599-31494a91966b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:17.742564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-107e593d-9c44-49b3-8599-31494a91966b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:17.743056 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-107e593d-9c44-49b3-8599-31494a91966b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:17.743830 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-107e593d-9c44-49b3-8599-31494a91966b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:17.744256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-107e593d-9c44-49b3-8599-31494a91966b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:17.899439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-107e593d-9c44-49b3-8599-31494a91966b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:17.907874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-107e593d-9c44-49b3-8599-31494a91966b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1507 microversion: 2.1 time: 0.179072 Jun 27 15:05:17.908553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 888/1138] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:17 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:18.927083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-46375aba-ed07-430a-ab92-da581f5294bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:18.928454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-46375aba-ed07-430a-ab92-da581f5294bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:18.937394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46375aba-ed07-430a-ab92-da581f5294bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:18.938237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46375aba-ed07-430a-ab92-da581f5294bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:18.939310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46375aba-ed07-430a-ab92-da581f5294bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:18.939909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46375aba-ed07-430a-ab92-da581f5294bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:19.000463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:19.161302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-46375aba-ed07-430a-ab92-da581f5294bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:19.168758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-46375aba-ed07-430a-ab92-da581f5294bb tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1507 microversion: 2.1 time: 0.246794 Jun 27 15:05:19.169575 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 889/1139] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:18 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:19.708792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-9c639399-79ea-4ac6-bace-50486bf76e72 req-26ef8864-2712-439f-969e-e20d3cc23e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebb517f-7c6e-4422-bd09-7bff9a8834ee", "name": "network-vif-deleted", "tag": "0b060973-e116-470e-9bd4-728c1c0bb917"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:19.718630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-9c639399-79ea-4ac6-bace-50486bf76e72 req-26ef8864-2712-439f-969e-e20d3cc23e04 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:19.719541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-9c639399-79ea-4ac6-bace-50486bf76e72 req-26ef8864-2712-439f-969e-e20d3cc23e04 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:19.736213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-9c639399-79ea-4ac6-bace-50486bf76e72 req-26ef8864-2712-439f-969e-e20d3cc23e04 service nova] Creating event network-vif-deleted:0b060973-e116-470e-9bd4-728c1c0bb917 for instance cebb517f-7c6e-4422-bd09-7bff9a8834ee on hv-cinder-79760 Jun 27 15:05:19.745714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-9c639399-79ea-4ac6-bace-50486bf76e72 req-26ef8864-2712-439f-969e-e20d3cc23e04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042217 Jun 27 15:05:19.747483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 890/1140] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:05:20.190729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:20.190729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:20.196086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:20.196530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:20.197315 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:20.197742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:20.229726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:20.230166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:20.230609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lazy-loading 'fault' on Instance uuid cebb517f-7c6e-4422-bd09-7bff9a8834ee {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:05:20.273061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:20.280402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9c8459f5-2075-42c3-87a0-887806c1d80b tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 200 len: 1311 microversion: 2.1 time: 0.098243 Jun 27 15:05:20.281204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 891/1141] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:20 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:21.299855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:21.300470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: cebb517f-7c6e-4422-bd09-7bff9a8834ee] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:21.303970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:21.308965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:21.309792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:21.310930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:21.311544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:21.329999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] HTTP exception thrown: Instance cebb517f-7c6e-4422-bd09-7bff9a8834ee could not be found. Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Request method failure captured: Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee HTTP/1.1 Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT-38-AhZx4ML0BgmtKnzrQGmAeYhVKp5jKaqxQFcQnA7Kr9cre3Cu91khx_2JaOxjv9r1Z9kio4dNU5xXRpzSPMGfJKKbnGnmOtztAdqgT6r_4hXcpZK59VXJPjHLS4pE-eo4l84UTzV0RLVRBOIDSf2e9NbVw6MW1nFAV0jqhI38 Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:21.332088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 27b0e2428571450ea1d5edfd1c3b0f80 Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance cebb517f-7c6e-4422-bd09-7bff9a8834ee could not be found. Jun 27 15:05:21.333821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'cebb517f-7c6e-4422-bd09-7bff9a8834ee'} Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cebb517f-7c6e-4422-bd09-7bff9a8834ee could not be found. Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:21.335331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebb517f-7c6e-4422-bd09-7bff9a8834ee could not be found. Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebb517f-7c6e-4422-bd09-7bff9a8834ee could not be found. Jun 27 15:05:21.336981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:21.338447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Returning 404 to user: Instance cebb517f-7c6e-4422-bd09-7bff9a8834ee could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:21.338447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a20ef61b-ffb6-4969-aeb8-4fe4553fd14c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee" status: 404 len: 111 microversion: 2.1 time: 0.037828 Jun 27 15:05:21.338447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 892/1142] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:21 2022] GET /compute/v2.1/servers/cebb517f-7c6e-4422-bd09-7bff9a8834ee => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:05:21.343473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-368e280c-206e-455b-a960-c26f1214621c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:21.348929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-368e280c-206e-455b-a960-c26f1214621c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:21.351819 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-368e280c-206e-455b-a960-c26f1214621c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:21.352504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-368e280c-206e-455b-a960-c26f1214621c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:21.353505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-368e280c-206e-455b-a960-c26f1214621c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:21.354177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-368e280c-206e-455b-a960-c26f1214621c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:21.391155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-368e280c-206e-455b-a960-c26f1214621c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:05:21.706064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-368e280c-206e-455b-a960-c26f1214621c tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 204 len: 0 microversion: 2.1 time: 0.366378 Jun 27 15:05:21.706727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 893/1143] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:05:21 2022] DELETE /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:05:21.715900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8399a118-17e8-451d-a2ce-1b2abd15def7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:21.717233 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8399a118-17e8-451d-a2ce-1b2abd15def7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:21.723351 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8399a118-17e8-451d-a2ce-1b2abd15def7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:21.723871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8399a118-17e8-451d-a2ce-1b2abd15def7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:21.724682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8399a118-17e8-451d-a2ce-1b2abd15def7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:21.725242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8399a118-17e8-451d-a2ce-1b2abd15def7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:21.870802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8399a118-17e8-451d-a2ce-1b2abd15def7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:21.878424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8399a118-17e8-451d-a2ce-1b2abd15def7 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.166590 Jun 27 15:05:21.878980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 894/1144] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:21 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:22.669450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-867b0245-9ce0-4c34-91ff-b6f23b2ef50b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:22.672141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-867b0245-9ce0-4c34-91ff-b6f23b2ef50b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:22.676151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-867b0245-9ce0-4c34-91ff-b6f23b2ef50b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:22.676889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-867b0245-9ce0-4c34-91ff-b6f23b2ef50b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:22.677840 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-867b0245-9ce0-4c34-91ff-b6f23b2ef50b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:22.678849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-867b0245-9ce0-4c34-91ff-b6f23b2ef50b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:22.703609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-867b0245-9ce0-4c34-91ff-b6f23b2ef50b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/ips" status: 200 len: 149 microversion: 2.1 time: 0.038276 Jun 27 15:05:22.704550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 895/1145] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:05:22 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:05:22.916726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6f39ab3b-1e41-436a-bf24-a07953f0ead2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:22.918475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6f39ab3b-1e41-436a-bf24-a07953f0ead2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:22.927937 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6f39ab3b-1e41-436a-bf24-a07953f0ead2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:22.929022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6f39ab3b-1e41-436a-bf24-a07953f0ead2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:22.930362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6f39ab3b-1e41-436a-bf24-a07953f0ead2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:22.931014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6f39ab3b-1e41-436a-bf24-a07953f0ead2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:23.127676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6f39ab3b-1e41-436a-bf24-a07953f0ead2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:23.137686 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6f39ab3b-1e41-436a-bf24-a07953f0ead2 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1523 microversion: 2.1 time: 0.243507 Jun 27 15:05:23.138425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 896/1146] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:22 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:23.387953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-5acece1f-05f1-45a8-9b2d-77e7a36c9b19 req-e1e383d7-9d82-4dba-aece-2b6cb91ffac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbec56f5-672a-4067-8656-c5d152daef90", "name": "network-vif-deleted", "tag": "dc6a0f8d-f77c-413a-9022-cbcffb6de783"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:23.398476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5acece1f-05f1-45a8-9b2d-77e7a36c9b19 req-e1e383d7-9d82-4dba-aece-2b6cb91ffac6 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:23.399221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5acece1f-05f1-45a8-9b2d-77e7a36c9b19 req-e1e383d7-9d82-4dba-aece-2b6cb91ffac6 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:23.410360 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-5acece1f-05f1-45a8-9b2d-77e7a36c9b19 req-e1e383d7-9d82-4dba-aece-2b6cb91ffac6 service nova] Creating event network-vif-deleted:dc6a0f8d-f77c-413a-9022-cbcffb6de783 for instance bbec56f5-672a-4067-8656-c5d152daef90 on hv-cinder-79760 Jun 27 15:05:23.415559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-5acece1f-05f1-45a8-9b2d-77e7a36c9b19 req-e1e383d7-9d82-4dba-aece-2b6cb91ffac6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Jun 27 15:05:23.416164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 897/1147] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:05:24.157461 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:24.159690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:24.168994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:24.169689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:24.171111 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:24.171723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:24.216616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:24.217361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:24.218119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lazy-loading 'fault' on Instance uuid bbec56f5-672a-4067-8656-c5d152daef90 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:05:24.265911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b0e2428571450ea1d5edfd1c3b0f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73553ee127a469b9cad0eda54e8c4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:24.273934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b52f33c9-a8da-4d9b-8974-061e811122e1 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 200 len: 1312 microversion: 2.1 time: 0.121474 Jun 27 15:05:24.274497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 898/1148] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:24 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 1312 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:25.292306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:25.293668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] [instance: bbec56f5-672a-4067-8656-c5d152daef90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:25.302787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:25.304543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:25.305197 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:25.305870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:25.332211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] HTTP exception thrown: Instance bbec56f5-672a-4067-8656-c5d152daef90 could not be found. Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Request method failure captured: Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 HTTP/1.1 Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT-38-AhZx4ML0BgmtKnzrQGmAeYhVKp5jKaqxQFcQnA7Kr9cre3Cu91khx_2JaOxjv9r1Z9kio4dNU5xXRpzSPMGfJKKbnGnmOtztAdqgT6r_4hXcpZK59VXJPjHLS4pE-eo4l84UTzV0RLVRBOIDSf2e9NbVw6MW1nFAV0jqhI38 Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:25.339174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c73553ee127a469b9cad0eda54e8c4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: c73553ee127a469b9cad0eda54e8c4a2 Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1904073665 Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 27b0e2428571450ea1d5edfd1c3b0f80 Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1904073665-project Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance bbec56f5-672a-4067-8656-c5d152daef90 could not be found. Jun 27 15:05:25.340996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'bbec56f5-672a-4067-8656-c5d152daef90'} Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbec56f5-672a-4067-8656-c5d152daef90 could not be found. Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:25.342407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbec56f5-672a-4067-8656-c5d152daef90 could not be found. Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbec56f5-672a-4067-8656-c5d152daef90 could not be found. Jun 27 15:05:25.343960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:25.346743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] Returning 404 to user: Instance bbec56f5-672a-4067-8656-c5d152daef90 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:25.346743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c5932ae6-b3cc-423b-adf6-41f478004680 tempest-ServerRescueNegativeTestJSON-1904073665 tempest-ServerRescueNegativeTestJSON-1904073665-project] 10.222.0.44 "GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90" status: 404 len: 111 microversion: 2.1 time: 0.048359 Jun 27 15:05:25.348932 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 899/1149] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:25 2022] GET /compute/v2.1/servers/bbec56f5-672a-4067-8656-c5d152daef90 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:05:25.548873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-40dbec85-9e69-40e5-bc70-2c6d7ade4f55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb5d5162-1fdc-426b-afe3-7ce7b86b4170"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:25.554390 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-40dbec85-9e69-40e5-bc70-2c6d7ade4f55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:25.557213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40dbec85-9e69-40e5-bc70-2c6d7ade4f55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:25.559824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40dbec85-9e69-40e5-bc70-2c6d7ade4f55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:25.561133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40dbec85-9e69-40e5-bc70-2c6d7ade4f55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:25.563413 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-40dbec85-9e69-40e5-bc70-2c6d7ade4f55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:26.389577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-40dbec85-9e69-40e5-bc70-2c6d7ade4f55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849542 Jun 27 15:05:26.396156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 900/1150] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:05:25 2022] POST /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments => generated 194 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:05:29.197004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d5e9c024-0cf9-4430-97f4-b1ad3521e14e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Action: 'create', calling method: .version_select at 0x7f13f960b430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1387064064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMReIMfSP5FfmybEEMfUUzehbwm+cCFbnC4LRTP3mKxk5gf8JGcMwlbdzOtnKQmeALf3LbSj3jA/R8FeGowGohT8MRAemVTwudHEGwyitXrl2UHTWXa7B7cZa4w4exXJEw=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:29.219024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-d5e9c024-0cf9-4430-97f4-b1ad3521e14e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Getting quotas for project 2bba2dfe000d427b9ab9dff2601436f1. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:05:29.235814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-d5e9c024-0cf9-4430-97f4-b1ad3521e14e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Getting quotas for user e6357e83df904ea09221cfc374d776c4 and project 2bba2dfe000d427b9ab9dff2601436f1. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:05:29.318019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d5e9c024-0cf9-4430-97f4-b1ad3521e14e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.355827 Jun 27 15:05:29.318687 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 901/1151] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 15:05:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:05:32.738585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e624ddb5-3faa-43ba-b370-17daa02634b6 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Action: 'create', calling method: .version_select at 0x7f13f9576d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2128832254", "metadata": {"Type": "work"}}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e624ddb5-3faa-43ba-b370-17daa02634b6 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Request method failure captured: Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 122 Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucc8-LtAniqSna6yKED87-h5-iSfh6Ah9ys9RoYix63TkUf8O898TEqCJFQPQUYB3GbJAOtrYSttrdErKlG0JV3IE4kC9WaUfvp3zWk_E5uFHFqIS73eYkhOmwp3XGAd5nKr8F6HCI2ZamIkD42Ox4GeNh81cp0ZX400cLntBbBxbtE Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:32.769944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6846f495d288493a974434927c584949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6846f495d288493a974434927c584949"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: bc7b5bd6b3154ea89e96d5e68f17fda8 Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2128832254", "metadata": {"Type": "work"}}} Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:05:32.771470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2128832254', 'metadata': {'Type': 'work'}}}} Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise error Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi '#$%' Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:32.772975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 15:05:32.774417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 15:05:32.776723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 15:05:32.776723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.776723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e624ddb5-3faa-43ba-b370-17daa02634b6 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:32.776723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e624ddb5-3faa-43ba-b370-17daa02634b6 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.161730 Jun 27 15:05:32.776723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 902/1152] 10.222.0.44 () {60 vars in 1155 bytes} [Mon Jun 27 15:05:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:05:32.783904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e25a050c-1284-4318-af19-f7ec35e83e77 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Action: 'create', calling method: .version_select at 0x7f13f9576ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-305231040", "metadata": {"Type": "work"}}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e25a050c-1284-4318-af19-f7ec35e83e77 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Request method failure captured: Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 119 Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucc8-LtAniqSna6yKED87-h5-iSfh6Ah9ys9RoYix63TkUf8O898TEqCJFQPQUYB3GbJAOtrYSttrdErKlG0JV3IE4kC9WaUfvp3zWk_E5uFHFqIS73eYkhOmwp3XGAd5nKr8F6HCI2ZamIkD42Ox4GeNh81cp0ZX400cLntBbBxbtE Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:32.786203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6846f495d288493a974434927c584949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6846f495d288493a974434927c584949"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: bc7b5bd6b3154ea89e96d5e68f17fda8 Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-305231040", "metadata": {"Type": "work"}}} Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:05:32.789423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-305231040', 'metadata': {'Type': 'work'}}}} Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise error Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi '0' Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:32.790697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 15:05:32.792441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 15:05:32.795577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 15:05:32.795577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.795577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e25a050c-1284-4318-af19-f7ec35e83e77 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:32.795577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e25a050c-1284-4318-af19-f7ec35e83e77 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008456 Jun 27 15:05:32.795577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 903/1153] 10.222.0.44 () {60 vars in 1155 bytes} [Mon Jun 27 15:05:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:05:32.798044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-adc596ea-6a28-46b2-80c6-7126410d92a4 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Action: 'create', calling method: .version_select at 0x7f13f960b820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1909312541", "metadata": {"Type": "work"}}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-adc596ea-6a28-46b2-80c6-7126410d92a4 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Request method failure captured: Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 119 Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucc8-LtAniqSna6yKED87-h5-iSfh6Ah9ys9RoYix63TkUf8O898TEqCJFQPQUYB3GbJAOtrYSttrdErKlG0JV3IE4kC9WaUfvp3zWk_E5uFHFqIS73eYkhOmwp3XGAd5nKr8F6HCI2ZamIkD42Ox4GeNh81cp0ZX400cLntBbBxbtE Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:32.800400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6846f495d288493a974434927c584949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6846f495d288493a974434927c584949"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: bc7b5bd6b3154ea89e96d5e68f17fda8 Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1909312541", "metadata": {"Type": "work"}}} Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:05:32.801925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1909312541', 'metadata': {'Type': 'work'}}}} Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise error Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi '' Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:32.802930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 15:05:32.804482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 15:05:32.805663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 15:05:32.805663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.805663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-adc596ea-6a28-46b2-80c6-7126410d92a4 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:32.805663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-adc596ea-6a28-46b2-80c6-7126410d92a4 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007787 Jun 27 15:05:32.805663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 904/1154] 10.222.0.44 () {60 vars in 1155 bytes} [Mon Jun 27 15:05:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:05:32.811949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7152175c-d05f-4fac-8a64-1eafafd6ca1a tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Calling method '.version_select at 0x7f13f9659a60>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:32.848437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-7152175c-d05f-4fac-8a64-1eafafd6ca1a tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] HTTP exception thrown: Volume tempest-invalid-880965484 could not be found. Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7152175c-d05f-4fac-8a64-1eafafd6ca1a tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Request method failure captured: Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-880965484 HTTP/1.1 Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucc8-LtAniqSna6yKED87-h5-iSfh6Ah9ys9RoYix63TkUf8O898TEqCJFQPQUYB3GbJAOtrYSttrdErKlG0JV3IE4kC9WaUfvp3zWk_E5uFHFqIS73eYkhOmwp3XGAd5nKr8F6HCI2ZamIkD42Ox4GeNh81cp0ZX400cLntBbBxbtE Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:32.860781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6846f495d288493a974434927c584949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6846f495d288493a974434927c584949"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: bc7b5bd6b3154ea89e96d5e68f17fda8 Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Volume tempest-invalid-880965484 could not be found. Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'tempest-invalid-880965484'} Jun 27 15:05:32.862401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-880965484 could not be found. (HTTP 404) (Request-ID: req-d2cd1d81-85b8-4d80-a4e1-e6324056b45f) Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.863441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:05:32.871849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-880965484 could not be found. Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:05:32.873135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-880965484 could not be found. Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-880965484 could not be found. Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7152175c-d05f-4fac-8a64-1eafafd6ca1a tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Returning 404 to user: Volume tempest-invalid-880965484 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7152175c-d05f-4fac-8a64-1eafafd6ca1a tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-880965484" status: 404 len: 98 microversion: 2.1 time: 0.057160 Jun 27 15:05:32.874477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 905/1155] 10.222.0.44 () {58 vars in 1214 bytes} [Mon Jun 27 15:05:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-880965484 => generated 98 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 27 15:05:32.877937 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2624224f-d27a-4c90-8a29-ee65f6cd50a2 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005884 Jun 27 15:05:32.878609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 906/1156] 10.222.0.44 () {58 vars in 1139 bytes} [Mon Jun 27 15:05:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 15:05:32.891664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e0ed8a72-aeea-498c-bd64-5626bdb0dbfb tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005080 Jun 27 15:05:32.892301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 907/1157] 10.222.0.44 () {58 vars in 1136 bytes} [Mon Jun 27 15:05:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 15:05:32.912203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-da12f0ed-dae5-4c80-acc5-596616ddfb67 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Calling method '.version_select at 0x7f13f95dc9d0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:32.949019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-da12f0ed-dae5-4c80-acc5-596616ddfb67 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] HTTP exception thrown: Volume d9a9f337-776b-4bea-ad3f-7ab2303b5b8c could not be found. Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-da12f0ed-dae5-4c80-acc5-596616ddfb67 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Request method failure captured: Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/os-volumes/d9a9f337-776b-4bea-ad3f-7ab2303b5b8c HTTP/1.1 Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucc8-LtAniqSna6yKED87-h5-iSfh6Ah9ys9RoYix63TkUf8O898TEqCJFQPQUYB3GbJAOtrYSttrdErKlG0JV3IE4kC9WaUfvp3zWk_E5uFHFqIS73eYkhOmwp3XGAd5nKr8F6HCI2ZamIkD42Ox4GeNh81cp0ZX400cLntBbBxbtE Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:32.951108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6846f495d288493a974434927c584949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6846f495d288493a974434927c584949"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: bc7b5bd6b3154ea89e96d5e68f17fda8 Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Volume d9a9f337-776b-4bea-ad3f-7ab2303b5b8c could not be found. Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'd9a9f337-776b-4bea-ad3f-7ab2303b5b8c'} Jun 27 15:05:32.952749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a9f337-776b-4bea-ad3f-7ab2303b5b8c could not be found. (HTTP 404) (Request-ID: req-2e2b548d-9e9a-441a-b44d-381629af5380) Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.953728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:05:32.954871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a9f337-776b-4bea-ad3f-7ab2303b5b8c could not be found. Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 15:05:32.956340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a9f337-776b-4bea-ad3f-7ab2303b5b8c could not be found. Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a9f337-776b-4bea-ad3f-7ab2303b5b8c could not be found. Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-da12f0ed-dae5-4c80-acc5-596616ddfb67 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Returning 404 to user: Volume d9a9f337-776b-4bea-ad3f-7ab2303b5b8c could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-da12f0ed-dae5-4c80-acc5-596616ddfb67 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/d9a9f337-776b-4bea-ad3f-7ab2303b5b8c" status: 404 len: 109 microversion: 2.1 time: 0.049466 Jun 27 15:05:32.958212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 908/1158] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:05:32 2022] DELETE /compute/v2.1/os-volumes/d9a9f337-776b-4bea-ad3f-7ab2303b5b8c => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:05:32.971496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cb00962a-fb8b-4d1f-a01b-ee6fba866165 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Calling method '.version_select at 0x7f13f95dc3a0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:33.005327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-cb00962a-fb8b-4d1f-a01b-ee6fba866165 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] HTTP exception thrown: Volume 081c2833-6d86-4d56-8588-b46a72e53854 could not be found. Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cb00962a-fb8b-4d1f-a01b-ee6fba866165 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Request method failure captured: Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/os-volumes/081c2833-6d86-4d56-8588-b46a72e53854 HTTP/1.1 Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucc8-LtAniqSna6yKED87-h5-iSfh6Ah9ys9RoYix63TkUf8O898TEqCJFQPQUYB3GbJAOtrYSttrdErKlG0JV3IE4kC9WaUfvp3zWk_E5uFHFqIS73eYkhOmwp3XGAd5nKr8F6HCI2ZamIkD42Ox4GeNh81cp0ZX400cLntBbBxbtE Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:33.008032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6846f495d288493a974434927c584949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6846f495d288493a974434927c584949"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6846f495d288493a974434927c584949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6846f495d288493a974434927c584949 Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesNegativeTest-1392608190 Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: bc7b5bd6b3154ea89e96d5e68f17fda8 Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesNegativeTest-1392608190-project Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Volume 081c2833-6d86-4d56-8588-b46a72e53854 could not be found. Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '081c2833-6d86-4d56-8588-b46a72e53854'} Jun 27 15:05:33.009549 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 081c2833-6d86-4d56-8588-b46a72e53854 could not be found. (HTTP 404) (Request-ID: req-73886219-afac-4de7-ad9a-978773e4292c) Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:33.010359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:05:33.011522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 081c2833-6d86-4d56-8588-b46a72e53854 could not be found. Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:05:33.013457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 081c2833-6d86-4d56-8588-b46a72e53854 could not be found. Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 081c2833-6d86-4d56-8588-b46a72e53854 could not be found. Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cb00962a-fb8b-4d1f-a01b-ee6fba866165 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] Returning 404 to user: Volume 081c2833-6d86-4d56-8588-b46a72e53854 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cb00962a-fb8b-4d1f-a01b-ee6fba866165 tempest-VolumesNegativeTest-1392608190 tempest-VolumesNegativeTest-1392608190-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/081c2833-6d86-4d56-8588-b46a72e53854" status: 404 len: 109 microversion: 2.1 time: 0.047700 Jun 27 15:05:33.015534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 909/1159] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:05:32 2022] GET /compute/v2.1/os-volumes/081c2833-6d86-4d56-8588-b46a72e53854 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:05:35.096891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb5d5162-1fdc-426b-afe3-7ce7b86b4170"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:35.098161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:35.106455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:35.106897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:35.108253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:35.109045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:35.195464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Invalid volume: volume fb5d5162-1fdc-426b-afe3-7ce7b86b4170 is already attached to instances: 0f842ec7-32eb-4898-8b26-dbb78e4616ea Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: POST /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments HTTP/1.1 Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 74 Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:35.197103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {"volumeAttachment": {"volumeId": "fb5d5162-1fdc-426b-afe3-7ce7b86b4170"}} Jun 27 15:05:35.198701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Invalid volume: volume fb5d5162-1fdc-426b-afe3-7ce7b86b4170 is already attached to instances: 0f842ec7-32eb-4898-8b26-dbb78e4616ea Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'server_id': '0f842ec7-32eb-4898-8b26-dbb78e4616ea', 'body': {'volumeAttachment': {'volumeId': 'fb5d5162-1fdc-426b-afe3-7ce7b86b4170'}}} Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fb5d5162-1fdc-426b-afe3-7ce7b86b4170 is already attached to instances: 0f842ec7-32eb-4898-8b26-dbb78e4616ea Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:35.199785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fb5d5162-1fdc-426b-afe3-7ce7b86b4170 is already attached to instances: 0f842ec7-32eb-4898-8b26-dbb78e4616ea Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:35.201216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:35.202749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:35.202749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:35.202749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:35.202749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fb5d5162-1fdc-426b-afe3-7ce7b86b4170 is already attached to instances: 0f842ec7-32eb-4898-8b26-dbb78e4616ea Jun 27 15:05:35.202749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:35.204125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 400 to user: Invalid volume: volume fb5d5162-1fdc-426b-afe3-7ce7b86b4170 is already attached to instances: 0f842ec7-32eb-4898-8b26-dbb78e4616ea {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:35.206447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2d2b7f45-9815-400c-9267-8a7cb01c9ece tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114227 Jun 27 15:05:35.207037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 910/1160] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:05:35 2022] POST /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:05:35.275707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-52d0d1a1-7dee-453a-bf41-b39449273908 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:35.276288 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-52d0d1a1-7dee-453a-bf41-b39449273908 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:35.282325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52d0d1a1-7dee-453a-bf41-b39449273908 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:35.282772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52d0d1a1-7dee-453a-bf41-b39449273908 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:35.283524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52d0d1a1-7dee-453a-bf41-b39449273908 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:35.283954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-52d0d1a1-7dee-453a-bf41-b39449273908 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:35.369571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-52d0d1a1-7dee-453a-bf41-b39449273908 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lazy-loading 'services' on Instance uuid 0f842ec7-32eb-4898-8b26-dbb78e4616ea {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:05:35.577554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-52d0d1a1-7dee-453a-bf41-b39449273908 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments/fb5d5162-1fdc-426b-afe3-7ce7b86b4170" status: 202 len: 0 microversion: 2.1 time: 0.306162 Jun 27 15:05:35.578155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 911/1161] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:05:35 2022] DELETE /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments/fb5d5162-1fdc-426b-afe3-7ce7b86b4170 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:05:35.587096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1bda1ebe-1d9a-496d-b5d1-f257d5621294 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:35.588168 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1bda1ebe-1d9a-496d-b5d1-f257d5621294 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:35.594655 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1bda1ebe-1d9a-496d-b5d1-f257d5621294 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:35.595102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1bda1ebe-1d9a-496d-b5d1-f257d5621294 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:35.595896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1bda1ebe-1d9a-496d-b5d1-f257d5621294 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:35.596354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1bda1ebe-1d9a-496d-b5d1-f257d5621294 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:35.627804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1bda1ebe-1d9a-496d-b5d1-f257d5621294 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044885 Jun 27 15:05:35.628476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 912/1162] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:05:35 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:05:36.640782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-092cdea2-8315-4894-ad6e-388780400cfa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:36.641825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-092cdea2-8315-4894-ad6e-388780400cfa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:36.649606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-092cdea2-8315-4894-ad6e-388780400cfa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:36.650051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-092cdea2-8315-4894-ad6e-388780400cfa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:36.650808 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-092cdea2-8315-4894-ad6e-388780400cfa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:36.651238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-092cdea2-8315-4894-ad6e-388780400cfa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:36.677515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:36.682941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-092cdea2-8315-4894-ad6e-388780400cfa tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045922 Jun 27 15:05:36.683574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 913/1163] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:05:36 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:05:37.694989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bed3ed86-64e6-4345-a1fa-bc2deea97d2e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:37.695901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bed3ed86-64e6-4345-a1fa-bc2deea97d2e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:37.704035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bed3ed86-64e6-4345-a1fa-bc2deea97d2e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:37.704476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bed3ed86-64e6-4345-a1fa-bc2deea97d2e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:37.705277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bed3ed86-64e6-4345-a1fa-bc2deea97d2e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:37.705708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bed3ed86-64e6-4345-a1fa-bc2deea97d2e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:37.735228 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bed3ed86-64e6-4345-a1fa-bc2deea97d2e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044451 Jun 27 15:05:37.735775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 914/1164] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:05:37 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:05:37.795503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-44013658-7c9c-4f65-80ed-2bac2efd82bf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:37.795993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-44013658-7c9c-4f65-80ed-2bac2efd82bf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:37.802279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-44013658-7c9c-4f65-80ed-2bac2efd82bf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:37.802839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-44013658-7c9c-4f65-80ed-2bac2efd82bf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:37.803782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-44013658-7c9c-4f65-80ed-2bac2efd82bf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:37.804221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-44013658-7c9c-4f65-80ed-2bac2efd82bf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:37.831115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-44013658-7c9c-4f65-80ed-2bac2efd82bf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:05:38.196598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-44013658-7c9c-4f65-80ed-2bac2efd82bf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 204 len: 0 microversion: 2.1 time: 0.404810 Jun 27 15:05:38.197412 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 915/1165] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:05:37 2022] DELETE /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:05:38.205770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9aabd47f-d36e-4b01-99f9-04d580963bf9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:38.206567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9aabd47f-d36e-4b01-99f9-04d580963bf9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:38.213174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9aabd47f-d36e-4b01-99f9-04d580963bf9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:38.213626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9aabd47f-d36e-4b01-99f9-04d580963bf9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:38.214408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9aabd47f-d36e-4b01-99f9-04d580963bf9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:38.214837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9aabd47f-d36e-4b01-99f9-04d580963bf9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:38.359988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9aabd47f-d36e-4b01-99f9-04d580963bf9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:38.367597 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9aabd47f-d36e-4b01-99f9-04d580963bf9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1681 microversion: 2.1 time: 0.165955 Jun 27 15:05:38.368165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 916/1166] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:38 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:39.385901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-97f90466-9200-46df-9051-b3ea404a8a1f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:39.386630 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-97f90466-9200-46df-9051-b3ea404a8a1f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:39.388918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=4 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:39.394225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97f90466-9200-46df-9051-b3ea404a8a1f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:39.395021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97f90466-9200-46df-9051-b3ea404a8a1f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:39.395854 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97f90466-9200-46df-9051-b3ea404a8a1f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:39.396471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-97f90466-9200-46df-9051-b3ea404a8a1f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:39.543610 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-97f90466-9200-46df-9051-b3ea404a8a1f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:39.559891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-97f90466-9200-46df-9051-b3ea404a8a1f tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1681 microversion: 2.1 time: 0.170103 Jun 27 15:05:39.559891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 917/1167] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:39 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:40.248206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-083f1531-e771-4199-9942-b56cb091bf73 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:40.248734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-083f1531-e771-4199-9942-b56cb091bf73 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:40.254922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-083f1531-e771-4199-9942-b56cb091bf73 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:40.255306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-083f1531-e771-4199-9942-b56cb091bf73 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:40.256064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-083f1531-e771-4199-9942-b56cb091bf73 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:40.256615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-083f1531-e771-4199-9942-b56cb091bf73 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:40.285271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-083f1531-e771-4199-9942-b56cb091bf73 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:05:40.596074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-083f1531-e771-4199-9942-b56cb091bf73 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 204 len: 0 microversion: 2.1 time: 0.352425 Jun 27 15:05:40.600889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 918/1168] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:05:40 2022] DELETE /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:05:40.607060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-6cc36084-6d3a-460c-ad16-4684feeb5b64 req-c1ff87cd-4c39-43a3-8e82-a06ed0b49f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08c8875-88c6-490f-a2a7-b0332d129e3d", "tag": "05abf890-aa38-4cf8-b0bb-92c6ba77980d"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:40.616793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6cc36084-6d3a-460c-ad16-4684feeb5b64 req-c1ff87cd-4c39-43a3-8e82-a06ed0b49f5a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:40.617525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6cc36084-6d3a-460c-ad16-4684feeb5b64 req-c1ff87cd-4c39-43a3-8e82-a06ed0b49f5a service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:40.632822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-6cc36084-6d3a-460c-ad16-4684feeb5b64 req-c1ff87cd-4c39-43a3-8e82-a06ed0b49f5a service nova] Creating event network-changed:05abf890-aa38-4cf8-b0bb-92c6ba77980d for instance e08c8875-88c6-490f-a2a7-b0332d129e3d on hv-cinder-79760 Jun 27 15:05:40.639784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-6cc36084-6d3a-460c-ad16-4684feeb5b64 req-c1ff87cd-4c39-43a3-8e82-a06ed0b49f5a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041529 Jun 27 15:05:40.640867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 919/1169] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:05:40.648250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7d571b79-d559-4d62-8f41-bc1a1a611817 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:40.649555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7d571b79-d559-4d62-8f41-bc1a1a611817 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:40.657997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7d571b79-d559-4d62-8f41-bc1a1a611817 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:40.658548 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7d571b79-d559-4d62-8f41-bc1a1a611817 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:40.659435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7d571b79-d559-4d62-8f41-bc1a1a611817 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:40.659868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7d571b79-d559-4d62-8f41-bc1a1a611817 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:40.811666 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7d571b79-d559-4d62-8f41-bc1a1a611817 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:40.820211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7d571b79-d559-4d62-8f41-bc1a1a611817 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1681 microversion: 2.1 time: 0.177974 Jun 27 15:05:40.820837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 920/1170] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:40 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:40.825707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e2c6727e-1fee-4211-8255-5e19c7d475fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:40.826511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e2c6727e-1fee-4211-8255-5e19c7d475fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:40.832820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2c6727e-1fee-4211-8255-5e19c7d475fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:40.833265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2c6727e-1fee-4211-8255-5e19c7d475fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:40.834035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2c6727e-1fee-4211-8255-5e19c7d475fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:40.834458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e2c6727e-1fee-4211-8255-5e19c7d475fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:40.980499 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e2c6727e-1fee-4211-8255-5e19c7d475fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:40.988129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e2c6727e-1fee-4211-8255-5e19c7d475fc tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.165880 Jun 27 15:05:40.998559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 921/1171] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:40 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:41.838395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-87d780f6-977b-4b5c-a9e7-d78fec2a040e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:41.839058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-87d780f6-977b-4b5c-a9e7-d78fec2a040e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:41.846268 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87d780f6-977b-4b5c-a9e7-d78fec2a040e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:41.847009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87d780f6-977b-4b5c-a9e7-d78fec2a040e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:41.848014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87d780f6-977b-4b5c-a9e7-d78fec2a040e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:41.848711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87d780f6-977b-4b5c-a9e7-d78fec2a040e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:41.924561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-87d780f6-977b-4b5c-a9e7-d78fec2a040e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:41.934538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-87d780f6-977b-4b5c-a9e7-d78fec2a040e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1613 microversion: 2.1 time: 0.099969 Jun 27 15:05:41.935167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 922/1172] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:41 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:42.004776 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c607e202-95b5-40d6-afd9-3f2d24dec1de tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:42.005408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c607e202-95b5-40d6-afd9-3f2d24dec1de tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:42.029665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c607e202-95b5-40d6-afd9-3f2d24dec1de tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:42.030128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c607e202-95b5-40d6-afd9-3f2d24dec1de tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:42.030903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c607e202-95b5-40d6-afd9-3f2d24dec1de tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:42.031340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c607e202-95b5-40d6-afd9-3f2d24dec1de tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:42.199407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c607e202-95b5-40d6-afd9-3f2d24dec1de tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:42.206844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c607e202-95b5-40d6-afd9-3f2d24dec1de tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1567 microversion: 2.1 time: 0.205859 Jun 27 15:05:42.207440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 923/1173] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:41 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:42.858564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-a3f289e9-d53a-4635-9f27-197177a37138 req-c588b469-c2eb-4715-9a17-c28779dc363e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f842ec7-32eb-4898-8b26-dbb78e4616ea", "name": "network-vif-deleted", "tag": "1f7a74e1-df0c-4bb9-a6cc-049be091782f"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:42.867096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-a3f289e9-d53a-4635-9f27-197177a37138 req-c588b469-c2eb-4715-9a17-c28779dc363e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:42.867534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-a3f289e9-d53a-4635-9f27-197177a37138 req-c588b469-c2eb-4715-9a17-c28779dc363e service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:42.879715 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-a3f289e9-d53a-4635-9f27-197177a37138 req-c588b469-c2eb-4715-9a17-c28779dc363e service nova] Creating event network-vif-deleted:1f7a74e1-df0c-4bb9-a6cc-049be091782f for instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea on hv-cinder-79760 Jun 27 15:05:42.885512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-a3f289e9-d53a-4635-9f27-197177a37138 req-c588b469-c2eb-4715-9a17-c28779dc363e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030138 Jun 27 15:05:42.886373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 924/1174] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:05:42.951962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:42.952703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:42.958973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:42.959690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:42.960566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:42.961034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:42.995550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:42.995995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:42.996442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lazy-loading 'fault' on Instance uuid 0f842ec7-32eb-4898-8b26-dbb78e4616ea {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:05:43.040980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:43.048767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-65e38cda-78dc-479a-88f6-6646ebd826e7 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 200 len: 1331 microversion: 2.1 time: 0.100913 Jun 27 15:05:43.049557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 925/1175] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:42 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:43.225093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-638054f6-db0e-43ff-bd25-a2353d463596 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:43.225957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-638054f6-db0e-43ff-bd25-a2353d463596 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:43.232775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-638054f6-db0e-43ff-bd25-a2353d463596 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:43.233478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-638054f6-db0e-43ff-bd25-a2353d463596 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:43.234437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-638054f6-db0e-43ff-bd25-a2353d463596 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:43.235026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-638054f6-db0e-43ff-bd25-a2353d463596 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:43.382446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-638054f6-db0e-43ff-bd25-a2353d463596 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:43.391261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-638054f6-db0e-43ff-bd25-a2353d463596 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1449 microversion: 2.1 time: 0.170091 Jun 27 15:05:43.392139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 926/1176] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:43 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:44.074093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:44.074762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:44.081464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:44.081919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:44.082809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:44.083246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:44.097894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea HTTP/1.1 Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:44.099592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:05:44.101223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '0f842ec7-32eb-4898-8b26-dbb78e4616ea'} Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:44.101971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:05:44.103946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:44.105262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:44.105262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5a075466-ede1-4b7d-909a-dc14728a8bb9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 404 len: 111 microversion: 2.1 time: 0.031013 Jun 27 15:05:44.105262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 927/1177] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:44 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:05:44.113881 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0650dba1-92a3-4fc1-9251-ba1a70a974cb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '.version_select at 0x7f13f9582dc0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:44.191538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0650dba1-92a3-4fc1-9251-ba1a70a974cb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362732370" status: 202 len: 0 microversion: 2.1 time: 0.081284 Jun 27 15:05:44.192050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 928/1178] 10.222.0.44 () {58 vars in 1220 bytes} [Mon Jun 27 15:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362732370 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:05:44.422906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4f487e1f-4b8c-412c-9380-b81955fe1d72 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:44.425772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4f487e1f-4b8c-412c-9380-b81955fe1d72 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:44.436238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f487e1f-4b8c-412c-9380-b81955fe1d72 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:44.436970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f487e1f-4b8c-412c-9380-b81955fe1d72 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:44.437984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f487e1f-4b8c-412c-9380-b81955fe1d72 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:44.438610 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4f487e1f-4b8c-412c-9380-b81955fe1d72 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:44.506426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4f487e1f-4b8c-412c-9380-b81955fe1d72 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f764a725deb405198f95d583035b371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253d5ed8735d445c930140b6d91136c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:44.510243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:44.515169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4f487e1f-4b8c-412c-9380-b81955fe1d72 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 200 len: 1218 microversion: 2.1 time: 0.097998 Jun 27 15:05:44.515850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 929/1179] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:44 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:44.905961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-d2befb37-8729-4033-9781-2e22654f00df req-e9af7b24-2b7c-4ad5-9781-99c4ccd690e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c8875-88c6-490f-a2a7-b0332d129e3d", "name": "network-vif-deleted", "tag": "05abf890-aa38-4cf8-b0bb-92c6ba77980d"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:44.914821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-d2befb37-8729-4033-9781-2e22654f00df req-e9af7b24-2b7c-4ad5-9781-99c4ccd690e1 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:44.915304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-d2befb37-8729-4033-9781-2e22654f00df req-e9af7b24-2b7c-4ad5-9781-99c4ccd690e1 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:44.926406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-d2befb37-8729-4033-9781-2e22654f00df req-e9af7b24-2b7c-4ad5-9781-99c4ccd690e1 service nova] Creating event network-vif-deleted:05abf890-aa38-4cf8-b0bb-92c6ba77980d for instance e08c8875-88c6-490f-a2a7-b0332d129e3d on hv-cinder-79760 Jun 27 15:05:44.931592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-d2befb37-8729-4033-9781-2e22654f00df req-e9af7b24-2b7c-4ad5-9781-99c4ccd690e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031328 Jun 27 15:05:44.932169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 930/1180] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:05:44.993518 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a7c14cf3-3d0d-4e57-99f0-6e982d1ffeb5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: .version_select at 0x7f13f9582310>, body: {"keypair": {"name": "tempest-keypair-1091920599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRkqiELpTq84pWw3rJAZnYYBP2e0SOiFnhtSPB9BNWWQVo1ZTJuUvv2MwQqHoheeffF6Tx+q3+LS+UDXe7YNHSicDtpywM7TnGA6cUBFEFGEUYkYGuPjiWPwKHIkvAQ0Q=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:45.007462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-a7c14cf3-3d0d-4e57-99f0-6e982d1ffeb5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for project 3d96ee908883411d9838f850ee7dd66b. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:05:45.010213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:45.013425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-a7c14cf3-3d0d-4e57-99f0-6e982d1ffeb5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for user d93abd4361d240919ec85cf4b92347fb and project 3d96ee908883411d9838f850ee7dd66b. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:05:45.117564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a7c14cf3-3d0d-4e57-99f0-6e982d1ffeb5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128760 Jun 27 15:05:45.118495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 931/1181] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 15:05:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:05:45.532869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:45.533646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] [instance: e08c8875-88c6-490f-a2a7-b0332d129e3d] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:45.541515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:45.541997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:45.542826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:45.543256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:45.557777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] HTTP exception thrown: Instance e08c8875-88c6-490f-a2a7-b0332d129e3d could not be found. Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Request method failure captured: Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d HTTP/1.1 Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucWUNMV1Vr_OU_T1V7zInuqR5BJWqE6P8KEVUvzCu-jqmQpqx0hcn1EaJtaOajHhfDQYFFuh4DxWIAlznKuhBMN_bs0OAOPpCJNzJEIm1zvz2XyAzzoEh4XU0mkL3LECSNWdawpv0zsnHT52b9948PAfYKOcxwTxlmgNimPw7Zn_J9c Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 253d5ed8735d445c930140b6d91136c8 Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-TestShelveInstance-970682517 Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:05:45.559468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_253d5ed8735d445c930140b6d91136c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/253d5ed8735d445c930140b6d91136c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/253d5ed8735d445c930140b6d91136c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/253d5ed8735d445c930140b6d91136c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-TestShelveInstance-970682517 Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 253d5ed8735d445c930140b6d91136c8 Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-TestShelveInstance-970682517 Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-TestShelveInstance-970682517-project Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 4f764a725deb405198f95d583035b371 Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-TestShelveInstance-970682517-project Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance e08c8875-88c6-490f-a2a7-b0332d129e3d could not be found. Jun 27 15:05:45.561068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'e08c8875-88c6-490f-a2a7-b0332d129e3d'} Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08c8875-88c6-490f-a2a7-b0332d129e3d could not be found. Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:05:45.561958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08c8875-88c6-490f-a2a7-b0332d129e3d could not be found. Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08c8875-88c6-490f-a2a7-b0332d129e3d could not be found. Jun 27 15:05:45.563206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:05:45.564356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Returning 404 to user: Instance e08c8875-88c6-490f-a2a7-b0332d129e3d could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:05:45.564356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2202a856-b2fb-424f-916c-533e4c28fdea tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d" status: 404 len: 111 microversion: 2.1 time: 0.032022 Jun 27 15:05:45.564356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 932/1182] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:45 2022] GET /compute/v2.1/servers/e08c8875-88c6-490f-a2a7-b0332d129e3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:05:45.835331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c130de88-52fc-41ba-ac14-874b6ad8de30 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] Calling method '.version_select at 0x7f13f9650160>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:45.958359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c130de88-52fc-41ba-ac14-874b6ad8de30 tempest-TestShelveInstance-970682517 tempest-TestShelveInstance-970682517-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-171805540" status: 202 len: 0 microversion: 2.1 time: 0.126886 Jun 27 15:05:45.959088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 933/1183] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:05:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-171805540 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:05:46.375016 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0ca5f52f-7279-4f43-91a4-ae34473b3d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:46.375761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0ca5f52f-7279-4f43-91a4-ae34473b3d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:46.382752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ca5f52f-7279-4f43-91a4-ae34473b3d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:46.383216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ca5f52f-7279-4f43-91a4-ae34473b3d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:46.384487 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ca5f52f-7279-4f43-91a4-ae34473b3d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:46.384957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0ca5f52f-7279-4f43-91a4-ae34473b3d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:46.409975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0ca5f52f-7279-4f43-91a4-ae34473b3d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/ips" status: 200 len: 150 microversion: 2.20 time: 0.039453 Jun 27 15:05:46.410767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 934/1184] 10.222.0.44 () {60 vars in 1288 bytes} [Mon Jun 27 15:05:46 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:05:47.680140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1667682007", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a5eed5b-e23d-40b2-b9c3-11f70e365ab5"}], "security_groups": [{"name": "tempest-securitygroup--848005426"}], "key_name": "tempest-keypair-1091920599", "user_data": "}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:47.869021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] validate_networks() for [('5a5eed5b-e23d-40b2-b9c3-11f70e365ab5', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:05:48.767343 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:05:48.767997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:05:48.775333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:05:48.775333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:05:48.775333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:05:48.779552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:48.780303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:48.781312 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:48.781907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:48.800402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for project 3d96ee908883411d9838f850ee7dd66b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:05:48.804842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Getting quotas for user d93abd4361d240919ec85cf4b92347fb and project 3d96ee908883411d9838f850ee7dd66b. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:05:48.822449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:05:48.824893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:05:48.930213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-72806ae1-d27e-4808-bcc6-6055555ee63c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.254564 Jun 27 15:05:48.930896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 935/1185] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:05:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:05:48.944803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e5ba6986-50df-4649-9f54-48254d62c089 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:48.946282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e5ba6986-50df-4649-9f54-48254d62c089 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:49.047321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e5ba6986-50df-4649-9f54-48254d62c089 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:49.054148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e5ba6986-50df-4649-9f54-48254d62c089 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1242 microversion: 2.1 time: 0.116437 Jun 27 15:05:49.054924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 936/1186] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:48 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:49.689983 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-64a6d9d9-39f4-4d9e-95c1-9f26b3dd4aa7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:49.693719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-64a6d9d9-39f4-4d9e-95c1-9f26b3dd4aa7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:49.700227 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-64a6d9d9-39f4-4d9e-95c1-9f26b3dd4aa7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:49.703490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-64a6d9d9-39f4-4d9e-95c1-9f26b3dd4aa7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:49.704304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-64a6d9d9-39f4-4d9e-95c1-9f26b3dd4aa7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:49.705226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-64a6d9d9-39f4-4d9e-95c1-9f26b3dd4aa7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:49.734166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-64a6d9d9-39f4-4d9e-95c1-9f26b3dd4aa7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lazy-loading 'flavor' on Instance uuid d8d41a61-4384-417c-8b5e-8ddd12ccf67a {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:05:50.328835 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-64a6d9d9-39f4-4d9e-95c1-9f26b3dd4aa7 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/action" status: 202 len: 0 microversion: 2.20 time: 0.643665 Jun 27 15:05:50.330141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 937/1187] 10.222.0.44 () {62 vars in 1318 bytes} [Mon Jun 27 15:05:49 2022] POST /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:05:50.335515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fb798ba9-62f3-4538-aa8b-2f6253049564 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:50.336560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fb798ba9-62f3-4538-aa8b-2f6253049564 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:50.349496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb798ba9-62f3-4538-aa8b-2f6253049564 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:50.349496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb798ba9-62f3-4538-aa8b-2f6253049564 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:50.349496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb798ba9-62f3-4538-aa8b-2f6253049564 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:50.349496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb798ba9-62f3-4538-aa8b-2f6253049564 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:50.412952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fb798ba9-62f3-4538-aa8b-2f6253049564 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:50.422056 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fb798ba9-62f3-4538-aa8b-2f6253049564 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1294 microversion: 2.1 time: 0.089810 Jun 27 15:05:50.435477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 938/1188] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:50 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:50.437225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:50.437824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:50.445194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:50.445577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:50.447156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:50.447600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:50.586143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:50.594931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:50.596638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:50.611723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d23c7371-bdc5-4b08-a256-85ff7cc2edfc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.164894 Jun 27 15:05:50.611723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 939/1189] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:05:50 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:05:51.573509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f0ad4920-8bb2-4aa9-8c9a-535d5c1b0d7e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:51.574117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f0ad4920-8bb2-4aa9-8c9a-535d5c1b0d7e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:51.580616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0ad4920-8bb2-4aa9-8c9a-535d5c1b0d7e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:51.581096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0ad4920-8bb2-4aa9-8c9a-535d5c1b0d7e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:51.581882 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0ad4920-8bb2-4aa9-8c9a-535d5c1b0d7e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:51.582449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0ad4920-8bb2-4aa9-8c9a-535d5c1b0d7e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:51.655857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f0ad4920-8bb2-4aa9-8c9a-535d5c1b0d7e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:51.664148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f0ad4920-8bb2-4aa9-8c9a-535d5c1b0d7e tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1300 microversion: 2.1 time: 0.224928 Jun 27 15:05:51.665291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 940/1190] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:51 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1300 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:51.671188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:51.672036 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:51.679319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:51.686286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:51.686286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:51.686286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:51.838887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:51.848262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:51.849901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:51.851053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a7ab9fed-c6cf-4232-b721-7accb876e2b5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.184531 Jun 27 15:05:51.851602 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 941/1191] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:05:51 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:05:52.682006 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cda632ef-f5a3-4b65-88df-29a8fe4e2b24 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:52.682831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cda632ef-f5a3-4b65-88df-29a8fe4e2b24 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:52.689091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cda632ef-f5a3-4b65-88df-29a8fe4e2b24 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:52.691280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cda632ef-f5a3-4b65-88df-29a8fe4e2b24 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:52.691280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cda632ef-f5a3-4b65-88df-29a8fe4e2b24 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:52.691280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cda632ef-f5a3-4b65-88df-29a8fe4e2b24 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:52.761931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cda632ef-f5a3-4b65-88df-29a8fe4e2b24 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:52.769891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cda632ef-f5a3-4b65-88df-29a8fe4e2b24 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1300 microversion: 2.1 time: 0.092064 Jun 27 15:05:52.771011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 942/1192] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:52 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:52.873774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:52.881096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:52.881096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:52.881096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:52.881798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:52.882231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:53.098417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:53.107555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:53.110524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:53.111947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cd66c493-d6c0-45f2-9dff-be06c75d6cf2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.242622 Jun 27 15:05:53.117218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 943/1193] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:05:52 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:05:53.794035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-71a306f5-ee15-4711-b3a9-6bafcb35dceb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:53.794035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-71a306f5-ee15-4711-b3a9-6bafcb35dceb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:53.797719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-71a306f5-ee15-4711-b3a9-6bafcb35dceb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:53.798241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-71a306f5-ee15-4711-b3a9-6bafcb35dceb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:53.799123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-71a306f5-ee15-4711-b3a9-6bafcb35dceb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:53.799618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-71a306f5-ee15-4711-b3a9-6bafcb35dceb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:53.966875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-71a306f5-ee15-4711-b3a9-6bafcb35dceb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:53.975164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-71a306f5-ee15-4711-b3a9-6bafcb35dceb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1367 microversion: 2.1 time: 0.191752 Jun 27 15:05:53.975742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 944/1194] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:53 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:54.130631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:54.131179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:54.139424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:54.139870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:54.140664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:54.141097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:54.468521 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:54.485063 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:54.498008 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:54.501484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fd937ec1-ee7d-48c2-b3bd-ae5ae4b6a5e9 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.375260 Jun 27 15:05:54.504423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 945/1195] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:05:54 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:05:54.506902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-621df173-73df-4265-b6a4-84c1857dc847 req-9f10ddbc-ed96-4242-b6b4-e5f5be409b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2255225e-ba1f-4556-8318-3caa2363e02b", "tag": "aad5dc86-8889-4b5e-9174-c330ac49ed21"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:54.515798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-621df173-73df-4265-b6a4-84c1857dc847 req-9f10ddbc-ed96-4242-b6b4-e5f5be409b9f service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:54.516244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-621df173-73df-4265-b6a4-84c1857dc847 req-9f10ddbc-ed96-4242-b6b4-e5f5be409b9f service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:54.531634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-621df173-73df-4265-b6a4-84c1857dc847 req-9f10ddbc-ed96-4242-b6b4-e5f5be409b9f service nova] Creating event network-changed:aad5dc86-8889-4b5e-9174-c330ac49ed21 for instance 2255225e-ba1f-4556-8318-3caa2363e02b on hv-cinder-79760 Jun 27 15:05:54.539196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-621df173-73df-4265-b6a4-84c1857dc847 req-9f10ddbc-ed96-4242-b6b4-e5f5be409b9f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034115 Jun 27 15:05:54.539521 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 946/1196] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:05:54.992660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-00319288-c90f-4a38-b804-e708694c5a0c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:54.994217 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-00319288-c90f-4a38-b804-e708694c5a0c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:55.000945 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00319288-c90f-4a38-b804-e708694c5a0c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:55.001708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00319288-c90f-4a38-b804-e708694c5a0c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:55.002689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00319288-c90f-4a38-b804-e708694c5a0c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:55.003118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-00319288-c90f-4a38-b804-e708694c5a0c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:55.147306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-00319288-c90f-4a38-b804-e708694c5a0c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:55.154797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-00319288-c90f-4a38-b804-e708694c5a0c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1367 microversion: 2.1 time: 0.166397 Jun 27 15:05:55.155354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 947/1197] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:54 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:55.692129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:55.696870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:55.699256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:55.699696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:55.700443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:55.700893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:55.849129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:55.857543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:55.859078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:55.860237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0800e243-da58-4be8-bddb-a57504b5362b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.343762 Jun 27 15:05:55.860813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 948/1198] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:05:55 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:05:56.171835 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-80a30574-6a31-4eb6-b0b4-300136b669c1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:56.172516 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-80a30574-6a31-4eb6-b0b4-300136b669c1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:56.178941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80a30574-6a31-4eb6-b0b4-300136b669c1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:56.184470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80a30574-6a31-4eb6-b0b4-300136b669c1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:56.184470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80a30574-6a31-4eb6-b0b4-300136b669c1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:56.184470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80a30574-6a31-4eb6-b0b4-300136b669c1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:56.320572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-80a30574-6a31-4eb6-b0b4-300136b669c1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:56.328441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-80a30574-6a31-4eb6-b0b4-300136b669c1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1367 microversion: 2.1 time: 0.160421 Jun 27 15:05:56.329038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 949/1199] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:56 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:56.878973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:56.879759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:56.886415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:56.886862 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:56.887626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:56.888062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:56.907406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:57.019764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:57.028356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:57.030010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:57.031246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ff3c9d03-44c3-4215-a521-d4ef5c3d88fc tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.156143 Jun 27 15:05:57.031890 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 950/1200] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:05:56 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:05:57.346052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3f7b76b2-cc88-463a-abbb-fbdf392f3f78 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:57.346767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3f7b76b2-cc88-463a-abbb-fbdf392f3f78 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:57.354306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f7b76b2-cc88-463a-abbb-fbdf392f3f78 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:57.354778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f7b76b2-cc88-463a-abbb-fbdf392f3f78 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:57.355547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f7b76b2-cc88-463a-abbb-fbdf392f3f78 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:57.355979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3f7b76b2-cc88-463a-abbb-fbdf392f3f78 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:57.506252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3f7b76b2-cc88-463a-abbb-fbdf392f3f78 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:57.518134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3f7b76b2-cc88-463a-abbb-fbdf392f3f78 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1367 microversion: 2.1 time: 0.173412 Jun 27 15:05:57.518134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 951/1201] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:57 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:05:57.820059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1588022273", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1387064064", "security_groups": [{"name": "tempest-secgroup-smoke-2040048435"}], "block_device_mapping_v2": [{"uuid": "39dfc8b6-d428-4b4a-b0d3-f344aa58b009", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "102de29a-dcd6-421f-8631-f35b90da1246"}]}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:05:57.933739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] validate_networks() for [('102de29a-dcd6-421f-8631-f35b90da1246', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:05:58.308834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:05:58.309359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:05:58.309918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:05:58.310411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:05:58.310919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:05:58.319557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:58.320060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:58.325060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:58.325060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:58.339380 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Getting quotas for project 2bba2dfe000d427b9ab9dff2601436f1. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:05:58.343276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Getting quotas for user e6357e83df904ea09221cfc374d776c4 and project 2bba2dfe000d427b9ab9dff2601436f1. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:05:58.398856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:05:58.401901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39dfc8b6-d428-4b4a-b0d3-f344aa58b009',volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:05:58.883420 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-941c38c3-a651-4c12-a7d7-46a12374d539 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.067522 Jun 27 15:05:58.888387 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 952/1202] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:05:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:05:58.892307 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:58.893134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:58.901307 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:58.907804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:58.907804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:58.907804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:59.069747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:59.078550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:59.080243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:59.081430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a7627df7-7795-4f30-8093-4af14aa5f5df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.195908 Jun 27 15:05:59.081993 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 953/1203] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:05:58 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:05:59.087117 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cee568e4-4ace-45dd-9a5b-9e820242c66c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:59.087882 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cee568e4-4ace-45dd-9a5b-9e820242c66c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:59.094128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cee568e4-4ace-45dd-9a5b-9e820242c66c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:59.094579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cee568e4-4ace-45dd-9a5b-9e820242c66c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:59.095340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cee568e4-4ace-45dd-9a5b-9e820242c66c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:05:59.095764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cee568e4-4ace-45dd-9a5b-9e820242c66c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:05:59.238128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cee568e4-4ace-45dd-9a5b-9e820242c66c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:59.246210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cee568e4-4ace-45dd-9a5b-9e820242c66c tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1367 microversion: 2.1 time: 0.163234 Jun 27 15:05:59.247186 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 954/1204] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:59 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:05:59.251401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-03208048-504e-4428-aab4-43fd49d1ea20 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:05:59.252007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-03208048-504e-4428-aab4-43fd49d1ea20 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:05:59.312006 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-03208048-504e-4428-aab4-43fd49d1ea20 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:05:59.319273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-03208048-504e-4428-aab4-43fd49d1ea20 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1095 microversion: 2.1 time: 0.071373 Jun 27 15:05:59.319755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 955/1205] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:05:59 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:00.099353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:00.100046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:00.106970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:00.107395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:00.108748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:00.108885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:00.553607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:00.562657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:00.564159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:00.565438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8bd5fcbf-ca37-46f5-bb86-be20848963fb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.470034 Jun 27 15:06:00.565989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 956/1206] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:00 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:00.570344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a74931b2-9702-47cc-bef8-b00608e9b49b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:00.571003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a74931b2-9702-47cc-bef8-b00608e9b49b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:00.576772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a74931b2-9702-47cc-bef8-b00608e9b49b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:00.577221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a74931b2-9702-47cc-bef8-b00608e9b49b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:00.580318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a74931b2-9702-47cc-bef8-b00608e9b49b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:00.580318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a74931b2-9702-47cc-bef8-b00608e9b49b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:00.734061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a74931b2-9702-47cc-bef8-b00608e9b49b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:00.743505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a74931b2-9702-47cc-bef8-b00608e9b49b tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1367 microversion: 2.1 time: 0.175900 Jun 27 15:06:00.753660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 957/1207] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:00 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:00.758657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-98a9052d-a6e0-468a-8f10-7feae5bb02ba tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:00.759273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-98a9052d-a6e0-468a-8f10-7feae5bb02ba tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:00.765172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-98a9052d-a6e0-468a-8f10-7feae5bb02ba tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:00.765625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-98a9052d-a6e0-468a-8f10-7feae5bb02ba tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:00.766381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-98a9052d-a6e0-468a-8f10-7feae5bb02ba tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:00.766812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-98a9052d-a6e0-468a-8f10-7feae5bb02ba tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:00.833362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-98a9052d-a6e0-468a-8f10-7feae5bb02ba tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:00.840663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-98a9052d-a6e0-468a-8f10-7feae5bb02ba tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1193 microversion: 2.1 time: 0.085982 Jun 27 15:06:00.841255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 958/1208] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:00 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:01.587122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:01.596076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:01.596076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:01.602083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:01.602889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:01.608833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:01.608833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:01.749827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:01.763998 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:01.765976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:01.768032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6fb36f19-2535-4188-aaca-c8e7e90a7855 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.188489 Jun 27 15:06:01.775729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 959/1209] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:01 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:01.780861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-069ebb82-0b21-4597-9fe2-5be46963b3d3 req-c599c2f6-4c19-4770-8c17-4bf27011c910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2255225e-ba1f-4556-8318-3caa2363e02b", "name": "network-vif-plugged", "status": "completed", "tag": "aad5dc86-8889-4b5e-9174-c330ac49ed21"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:01.794611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-069ebb82-0b21-4597-9fe2-5be46963b3d3 req-c599c2f6-4c19-4770-8c17-4bf27011c910 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:01.795043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-069ebb82-0b21-4597-9fe2-5be46963b3d3 req-c599c2f6-4c19-4770-8c17-4bf27011c910 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:01.807144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-069ebb82-0b21-4597-9fe2-5be46963b3d3 req-c599c2f6-4c19-4770-8c17-4bf27011c910 service nova] Creating event network-vif-plugged:aad5dc86-8889-4b5e-9174-c330ac49ed21 for instance 2255225e-ba1f-4556-8318-3caa2363e02b on hv-cinder-79760 Jun 27 15:06:01.812548 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-069ebb82-0b21-4597-9fe2-5be46963b3d3 req-c599c2f6-4c19-4770-8c17-4bf27011c910 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035238 Jun 27 15:06:01.813457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 960/1210] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:06:01.819513 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8abe789c-fc60-49d8-bce6-c23dd98661d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:01.820211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8abe789c-fc60-49d8-bce6-c23dd98661d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:01.827828 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8abe789c-fc60-49d8-bce6-c23dd98661d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:01.828484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8abe789c-fc60-49d8-bce6-c23dd98661d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:01.829452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8abe789c-fc60-49d8-bce6-c23dd98661d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:01.830065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8abe789c-fc60-49d8-bce6-c23dd98661d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:02.007253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8abe789c-fc60-49d8-bce6-c23dd98661d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:02.016319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8abe789c-fc60-49d8-bce6-c23dd98661d1 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1367 microversion: 2.1 time: 0.201484 Jun 27 15:06:02.017206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 961/1211] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:01 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:02.022240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-60bbcd23-9890-49ac-9310-28639c252e48 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:02.023055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-60bbcd23-9890-49ac-9310-28639c252e48 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:02.031081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60bbcd23-9890-49ac-9310-28639c252e48 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:02.031594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60bbcd23-9890-49ac-9310-28639c252e48 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:02.034762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60bbcd23-9890-49ac-9310-28639c252e48 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:02.034762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-60bbcd23-9890-49ac-9310-28639c252e48 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:02.104114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-60bbcd23-9890-49ac-9310-28639c252e48 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:02.112548 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-60bbcd23-9890-49ac-9310-28639c252e48 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1211 microversion: 2.1 time: 0.094155 Jun 27 15:06:02.113502 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 962/1212] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:02 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:02.796911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:02.797756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:02.805663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:02.806489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:02.807321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:02.807961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:02.979508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:02.987892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:02.990464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:02.991463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-433958bf-81b5-49d2-98d0-8419e8778269 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.198972 Jun 27 15:06:02.992327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 963/1213] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:02 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:03.034742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-208177d8-5a9a-441f-b56e-f89f1945f8fd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:03.035390 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-208177d8-5a9a-441f-b56e-f89f1945f8fd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:03.042551 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-208177d8-5a9a-441f-b56e-f89f1945f8fd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:03.043049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-208177d8-5a9a-441f-b56e-f89f1945f8fd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:03.043809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-208177d8-5a9a-441f-b56e-f89f1945f8fd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:03.044236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-208177d8-5a9a-441f-b56e-f89f1945f8fd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:03.184770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-208177d8-5a9a-441f-b56e-f89f1945f8fd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:03.198649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-208177d8-5a9a-441f-b56e-f89f1945f8fd tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1367 microversion: 2.1 time: 0.167732 Jun 27 15:06:03.209821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 964/1214] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:03 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:03.218612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cbea1232-8e29-47d3-8263-09b4b2b938cc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:03.218612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cbea1232-8e29-47d3-8263-09b4b2b938cc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:03.226271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbea1232-8e29-47d3-8263-09b4b2b938cc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:03.227956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbea1232-8e29-47d3-8263-09b4b2b938cc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:03.229122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbea1232-8e29-47d3-8263-09b4b2b938cc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:03.230122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cbea1232-8e29-47d3-8263-09b4b2b938cc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:03.410516 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cbea1232-8e29-47d3-8263-09b4b2b938cc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:03.421530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cbea1232-8e29-47d3-8263-09b4b2b938cc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1279 microversion: 2.1 time: 0.209779 Jun 27 15:06:03.423043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 965/1215] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:03 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:03.609567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-02c4dc96-9045-4235-8985-f6bacbab88c8 req-3b83bf36-f4e7-4ce1-9388-22a104b6abdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4300d49-751c-4048-bde6-5d4a1d940515", "tag": "6780a0e6-aa6c-4742-b45f-385a5bbf0b86"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:03.619767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-02c4dc96-9045-4235-8985-f6bacbab88c8 req-3b83bf36-f4e7-4ce1-9388-22a104b6abdb service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:03.620030 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-02c4dc96-9045-4235-8985-f6bacbab88c8 req-3b83bf36-f4e7-4ce1-9388-22a104b6abdb service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:03.645214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-02c4dc96-9045-4235-8985-f6bacbab88c8 req-3b83bf36-f4e7-4ce1-9388-22a104b6abdb service nova] Creating event network-changed:6780a0e6-aa6c-4742-b45f-385a5bbf0b86 for instance a4300d49-751c-4048-bde6-5d4a1d940515 on hv-cinder-79760 Jun 27 15:06:03.654135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-02c4dc96-9045-4235-8985-f6bacbab88c8 req-3b83bf36-f4e7-4ce1-9388-22a104b6abdb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048101 Jun 27 15:06:03.654971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 966/1216] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:06:04.013598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:04.014490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:04.024954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:04.029189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:04.029189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:04.029189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:04.206935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:04.216677 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:04.218442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:04.219595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c00d0e35-16dd-4adf-83c7-a7196daaf2fa tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.212960 Jun 27 15:06:04.220147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 967/1217] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:04 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:04.224864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9dbe87bb-3e64-4849-8d7b-19d83a7482a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:04.225642 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9dbe87bb-3e64-4849-8d7b-19d83a7482a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:04.232966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dbe87bb-3e64-4849-8d7b-19d83a7482a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:04.233407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dbe87bb-3e64-4849-8d7b-19d83a7482a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:04.234183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dbe87bb-3e64-4849-8d7b-19d83a7482a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:04.234608 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dbe87bb-3e64-4849-8d7b-19d83a7482a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:04.377676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9dbe87bb-3e64-4849-8d7b-19d83a7482a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:04.386424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9dbe87bb-3e64-4849-8d7b-19d83a7482a3 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1557 microversion: 2.1 time: 0.165255 Jun 27 15:06:04.393584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 968/1218] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:04 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:04.402793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2d145677-9745-41d6-9a3f-14b8b24c61f8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:04.404364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2d145677-9745-41d6-9a3f-14b8b24c61f8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:04.411083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d145677-9745-41d6-9a3f-14b8b24c61f8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:04.411532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d145677-9745-41d6-9a3f-14b8b24c61f8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:04.412319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d145677-9745-41d6-9a3f-14b8b24c61f8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:04.412762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2d145677-9745-41d6-9a3f-14b8b24c61f8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:04.499361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2d145677-9745-41d6-9a3f-14b8b24c61f8 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100595 Jun 27 15:06:04.499961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 969/1219] 10.222.0.44 () {58 vars in 1274 bytes} [Mon Jun 27 15:06:04 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:06:04.504444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fb99517c-f560-44ce-94a1-cb9992cc69d5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:04.518562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fb99517c-f560-44ce-94a1-cb9992cc69d5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:04.518562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb99517c-f560-44ce-94a1-cb9992cc69d5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:04.518562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb99517c-f560-44ce-94a1-cb9992cc69d5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:04.518562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb99517c-f560-44ce-94a1-cb9992cc69d5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:04.519204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb99517c-f560-44ce-94a1-cb9992cc69d5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:04.532150 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:04.659135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fb99517c-f560-44ce-94a1-cb9992cc69d5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:04.667457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fb99517c-f560-44ce-94a1-cb9992cc69d5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.166442 Jun 27 15:06:04.673223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 970/1220] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:04 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:05.237748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:05.238524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:05.245992 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:05.246441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:05.247216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:05.247656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:05.394177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:05.403053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:05.404542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:05.416537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4ca5a38e-bf56-4331-b53e-0718dd13c0b4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.172062 Jun 27 15:06:05.416537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 971/1221] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:05 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:05.685701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f0f0f20b-0021-40cf-93a3-2c6e0468cb91 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:05.686303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f0f0f20b-0021-40cf-93a3-2c6e0468cb91 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:05.692558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0f0f20b-0021-40cf-93a3-2c6e0468cb91 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:05.693033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0f0f20b-0021-40cf-93a3-2c6e0468cb91 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:05.693797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0f0f20b-0021-40cf-93a3-2c6e0468cb91 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:05.694226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f0f0f20b-0021-40cf-93a3-2c6e0468cb91 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:05.828564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f0f0f20b-0021-40cf-93a3-2c6e0468cb91 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:05.837198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f0f0f20b-0021-40cf-93a3-2c6e0468cb91 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.154915 Jun 27 15:06:05.837778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 972/1222] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:05 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:06.188680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-cbdf8038-903a-4469-91a0-9a2c5f722aec req-b14227fd-c894-4ef5-abb4-40b1f8095862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2255225e-ba1f-4556-8318-3caa2363e02b", "tag": "aad5dc86-8889-4b5e-9174-c330ac49ed21"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:06.197693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-cbdf8038-903a-4469-91a0-9a2c5f722aec req-b14227fd-c894-4ef5-abb4-40b1f8095862 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:06.198133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-cbdf8038-903a-4469-91a0-9a2c5f722aec req-b14227fd-c894-4ef5-abb4-40b1f8095862 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:06.211304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-cbdf8038-903a-4469-91a0-9a2c5f722aec req-b14227fd-c894-4ef5-abb4-40b1f8095862 service nova] Creating event network-changed:aad5dc86-8889-4b5e-9174-c330ac49ed21 for instance 2255225e-ba1f-4556-8318-3caa2363e02b on hv-cinder-79760 Jun 27 15:06:06.216618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-cbdf8038-903a-4469-91a0-9a2c5f722aec req-b14227fd-c894-4ef5-abb4-40b1f8095862 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031530 Jun 27 15:06:06.217537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 973/1223] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:06:06.424429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:06.425349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:06.433585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:06.443178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:06.443178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:06.443178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:06.593344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:06.602495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:06.605812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:06.607205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c1c73b64-9720-4309-a4c8-70148f45690a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.187681 Jun 27 15:06:06.619719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 974/1224] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:06 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:06.855400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d9b613f3-df30-4204-b170-2ce60ac35b95 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:06.856087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d9b613f3-df30-4204-b170-2ce60ac35b95 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:06.862777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9b613f3-df30-4204-b170-2ce60ac35b95 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:06.863527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9b613f3-df30-4204-b170-2ce60ac35b95 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:06.864537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9b613f3-df30-4204-b170-2ce60ac35b95 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:06.865238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d9b613f3-df30-4204-b170-2ce60ac35b95 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:07.065458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d9b613f3-df30-4204-b170-2ce60ac35b95 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:07.074365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d9b613f3-df30-4204-b170-2ce60ac35b95 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.224335 Jun 27 15:06:07.075103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 975/1225] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:06 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:07.625995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:07.626811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:07.633790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:07.634244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:07.635017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:07.635442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:07.771799 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:07.779348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:07.781246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:07.782445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b52d813c-6ad1-4014-86f6-42d3c2efc08a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1742 microversion: 2.20 time: 0.160534 Jun 27 15:06:07.783277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 976/1226] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:07 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:08.091151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c04bb046-b24c-40bb-8dd7-3179a6da454d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:08.091758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c04bb046-b24c-40bb-8dd7-3179a6da454d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:08.098916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c04bb046-b24c-40bb-8dd7-3179a6da454d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:08.099444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c04bb046-b24c-40bb-8dd7-3179a6da454d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:08.100378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c04bb046-b24c-40bb-8dd7-3179a6da454d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:08.101512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c04bb046-b24c-40bb-8dd7-3179a6da454d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:08.241793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c04bb046-b24c-40bb-8dd7-3179a6da454d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:08.258043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c04bb046-b24c-40bb-8dd7-3179a6da454d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.163212 Jun 27 15:06:08.258043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 977/1227] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:08 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:08.801483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:08.802110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:08.803995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=4 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:08.809658 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:08.810101 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:08.810852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:08.811277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:08.941353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:08.949764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:08.951263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:08.952407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-50b69b35-96c8-4778-a053-8ba7f197c098 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1742 microversion: 2.20 time: 0.154935 Jun 27 15:06:08.952995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 978/1228] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:08 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:09.266164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-106696a3-3cf8-44c7-bc4d-a3a90ed89919 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:09.266765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-106696a3-3cf8-44c7-bc4d-a3a90ed89919 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:09.272699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-106696a3-3cf8-44c7-bc4d-a3a90ed89919 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:09.273144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-106696a3-3cf8-44c7-bc4d-a3a90ed89919 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:09.274285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-106696a3-3cf8-44c7-bc4d-a3a90ed89919 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:09.274717 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-106696a3-3cf8-44c7-bc4d-a3a90ed89919 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:09.316409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=20 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:09.407350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-106696a3-3cf8-44c7-bc4d-a3a90ed89919 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:09.415650 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-106696a3-3cf8-44c7-bc4d-a3a90ed89919 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.153347 Jun 27 15:06:09.416431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 979/1229] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:09 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:09.971223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:09.971875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:09.979267 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:09.979719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:09.980492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:09.980957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:10.113279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:10.121310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:10.122786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:10.123924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8103e1a0-f2e8-4379-9eeb-418a2187754e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1742 microversion: 2.20 time: 0.156807 Jun 27 15:06:10.124480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 980/1230] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:09 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:10.432502 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-417ed42d-7505-4a40-a7a2-8d375a8f5526 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:10.433166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-417ed42d-7505-4a40-a7a2-8d375a8f5526 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:10.439132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-417ed42d-7505-4a40-a7a2-8d375a8f5526 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:10.439584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-417ed42d-7505-4a40-a7a2-8d375a8f5526 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:10.443225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-417ed42d-7505-4a40-a7a2-8d375a8f5526 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:10.443225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-417ed42d-7505-4a40-a7a2-8d375a8f5526 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:10.574754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-417ed42d-7505-4a40-a7a2-8d375a8f5526 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:10.582128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-417ed42d-7505-4a40-a7a2-8d375a8f5526 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.153751 Jun 27 15:06:10.582678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 981/1231] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:10 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:11.142202 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:11.142843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:11.150096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:11.150536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:11.151299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:11.151738 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:11.285139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:11.293511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:11.295021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:11.296203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-99f29833-f453-40f5-bfcc-4e7450310784 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1742 microversion: 2.20 time: 0.157923 Jun 27 15:06:11.296802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 982/1232] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:11 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:11.584476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-48982894-17cd-4345-97ea-064f36929147 req-195dd88a-935e-47ce-beb7-0a1323cf629c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d41a61-4384-417c-8b5e-8ddd12ccf67a", "name": "network-vif-plugged", "status": "completed", "tag": "bef0c110-529a-43f2-91a5-47a11127e1ad"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:11.593528 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-48982894-17cd-4345-97ea-064f36929147 req-195dd88a-935e-47ce-beb7-0a1323cf629c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:11.594190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-48982894-17cd-4345-97ea-064f36929147 req-195dd88a-935e-47ce-beb7-0a1323cf629c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:11.606212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-48982894-17cd-4345-97ea-064f36929147 req-195dd88a-935e-47ce-beb7-0a1323cf629c service nova] Creating event network-vif-plugged:bef0c110-529a-43f2-91a5-47a11127e1ad for instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a on hv-cinder-79760 Jun 27 15:06:11.611492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-48982894-17cd-4345-97ea-064f36929147 req-195dd88a-935e-47ce-beb7-0a1323cf629c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030723 Jun 27 15:06:11.612085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 983/1233] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:06:11.617049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-90fcc135-2a10-4402-bc41-997c8ec778c5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:11.618557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-90fcc135-2a10-4402-bc41-997c8ec778c5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:11.624726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90fcc135-2a10-4402-bc41-997c8ec778c5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:11.625180 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90fcc135-2a10-4402-bc41-997c8ec778c5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:11.625937 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90fcc135-2a10-4402-bc41-997c8ec778c5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:11.626376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-90fcc135-2a10-4402-bc41-997c8ec778c5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:11.767523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-90fcc135-2a10-4402-bc41-997c8ec778c5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:11.776096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-90fcc135-2a10-4402-bc41-997c8ec778c5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.162760 Jun 27 15:06:11.776924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 984/1234] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:11 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:12.315775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:12.316459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:12.323262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:12.323773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:12.324610 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:12.325068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:12.460254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:12.468562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:12.470055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:12.471185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1df33ede-7021-4945-be85-7510635abdd8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1742 microversion: 2.20 time: 0.159711 Jun 27 15:06:12.471746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 985/1235] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:12 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:12.793010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2be15b9f-b6c0-4abe-a24d-ce9978caa4c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:12.793697 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2be15b9f-b6c0-4abe-a24d-ce9978caa4c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:12.799637 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2be15b9f-b6c0-4abe-a24d-ce9978caa4c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:12.800078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2be15b9f-b6c0-4abe-a24d-ce9978caa4c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:12.800924 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2be15b9f-b6c0-4abe-a24d-ce9978caa4c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:12.801363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2be15b9f-b6c0-4abe-a24d-ce9978caa4c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:12.934426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2be15b9f-b6c0-4abe-a24d-ce9978caa4c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:12.942079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2be15b9f-b6c0-4abe-a24d-ce9978caa4c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.152914 Jun 27 15:06:12.942657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 986/1236] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:12 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:13.491490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:13.492949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:13.499676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:13.500121 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:13.500971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:13.501402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:13.634912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:13.643029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:13.644518 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:13.645974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9073ec52-4ed1-47bb-aef2-308638dd71f8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.159454 Jun 27 15:06:13.648681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 987/1237] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:13 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:13.959614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fb6013f3-bd17-417f-a708-b60f12e8c607 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:13.960138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fb6013f3-bd17-417f-a708-b60f12e8c607 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:13.967403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb6013f3-bd17-417f-a708-b60f12e8c607 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:13.967847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb6013f3-bd17-417f-a708-b60f12e8c607 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:13.968604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb6013f3-bd17-417f-a708-b60f12e8c607 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:13.969232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb6013f3-bd17-417f-a708-b60f12e8c607 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:13.990846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:14.160738 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fb6013f3-bd17-417f-a708-b60f12e8c607 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:14.170893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fb6013f3-bd17-417f-a708-b60f12e8c607 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.215194 Jun 27 15:06:14.172059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 988/1238] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:13 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:14.665045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:14.667288 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:14.674386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:14.674912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:14.675748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:14.676385 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:14.861909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:14.871028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:14.874221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:14.875591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-289d5586-ff30-4b69-ac24-95c80189252a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.214431 Jun 27 15:06:14.876340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 989/1239] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:14 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:06:15.195859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-eb2dde26-6dc6-49fa-b6ce-e529d8138b55 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:15.196679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-eb2dde26-6dc6-49fa-b6ce-e529d8138b55 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:15.203158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb2dde26-6dc6-49fa-b6ce-e529d8138b55 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:15.204094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb2dde26-6dc6-49fa-b6ce-e529d8138b55 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:15.205331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb2dde26-6dc6-49fa-b6ce-e529d8138b55 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:15.206001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb2dde26-6dc6-49fa-b6ce-e529d8138b55 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:15.367177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-eb2dde26-6dc6-49fa-b6ce-e529d8138b55 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:15.377049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-eb2dde26-6dc6-49fa-b6ce-e529d8138b55 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.191914 Jun 27 15:06:15.377874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 990/1240] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:15 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:15.895087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:15.895847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:15.902822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:15.903590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:15.907494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:15.907494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:16.088519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:16.098178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:16.100151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:16.101568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1255c57b-f466-401d-b9f2-a70dd5428f3e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.210430 Jun 27 15:06:16.113122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 991/1241] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:15 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:16.395490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0658a7c3-5d4a-4233-80b2-3943fcb3c22d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:16.396372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0658a7c3-5d4a-4233-80b2-3943fcb3c22d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:16.410936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0658a7c3-5d4a-4233-80b2-3943fcb3c22d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:16.411944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0658a7c3-5d4a-4233-80b2-3943fcb3c22d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:16.414044 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0658a7c3-5d4a-4233-80b2-3943fcb3c22d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:16.417341 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0658a7c3-5d4a-4233-80b2-3943fcb3c22d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:16.749700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0658a7c3-5d4a-4233-80b2-3943fcb3c22d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:16.749700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0658a7c3-5d4a-4233-80b2-3943fcb3c22d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.205400 Jun 27 15:06:16.749700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 992/1242] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:16 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:17.122112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:17.123589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:17.130496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:17.130998 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:17.134537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:17.134537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:17.292010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:17.301153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:17.302660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:17.303832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-68e66d6f-40c3-4572-832c-0a350b7f7e09 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.186699 Jun 27 15:06:17.304719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 993/1243] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:17 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:17.768905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fb9639b6-2ef4-408b-9c6a-f288ca737e90 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:17.770347 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fb9639b6-2ef4-408b-9c6a-f288ca737e90 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:17.779333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb9639b6-2ef4-408b-9c6a-f288ca737e90 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:17.780146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb9639b6-2ef4-408b-9c6a-f288ca737e90 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:17.781175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb9639b6-2ef4-408b-9c6a-f288ca737e90 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:17.781831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb9639b6-2ef4-408b-9c6a-f288ca737e90 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:17.975720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fb9639b6-2ef4-408b-9c6a-f288ca737e90 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:17.984752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fb9639b6-2ef4-408b-9c6a-f288ca737e90 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.221369 Jun 27 15:06:17.986000 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 994/1244] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:17 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:17.998140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-4e1daeaa-43fe-4ab1-b5cf-e812d2f774e1 req-76fdb952-f245-45d2-880d-dfe43413adec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4300d49-751c-4048-bde6-5d4a1d940515", "name": "network-vif-plugged", "status": "completed", "tag": "6780a0e6-aa6c-4742-b45f-385a5bbf0b86"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:18.006441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-4e1daeaa-43fe-4ab1-b5cf-e812d2f774e1 req-76fdb952-f245-45d2-880d-dfe43413adec service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:18.007022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-4e1daeaa-43fe-4ab1-b5cf-e812d2f774e1 req-76fdb952-f245-45d2-880d-dfe43413adec service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:18.019055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-4e1daeaa-43fe-4ab1-b5cf-e812d2f774e1 req-76fdb952-f245-45d2-880d-dfe43413adec service nova] Creating event network-vif-plugged:6780a0e6-aa6c-4742-b45f-385a5bbf0b86 for instance a4300d49-751c-4048-bde6-5d4a1d940515 on hv-cinder-79760 Jun 27 15:06:18.025968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-4e1daeaa-43fe-4ab1-b5cf-e812d2f774e1 req-76fdb952-f245-45d2-880d-dfe43413adec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037933 Jun 27 15:06:18.027173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 995/1245] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:06:18.323232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:18.324084 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:18.331242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:18.332155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:18.332950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:18.335748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:18.552681 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:18.563567 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:18.568867 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:18.570859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ca4fe47a-e9d1-4367-a69b-c4e5fa31caf1 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.252699 Jun 27 15:06:18.573889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 996/1246] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:18 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:19.001764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8e3b7982-688d-416e-9138-561fd8a2d30e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:19.002645 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8e3b7982-688d-416e-9138-561fd8a2d30e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:19.009580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e3b7982-688d-416e-9138-561fd8a2d30e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:19.010223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e3b7982-688d-416e-9138-561fd8a2d30e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:19.011175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e3b7982-688d-416e-9138-561fd8a2d30e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:19.011787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8e3b7982-688d-416e-9138-561fd8a2d30e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:19.204185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8e3b7982-688d-416e-9138-561fd8a2d30e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:19.216885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8e3b7982-688d-416e-9138-561fd8a2d30e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.218998 Jun 27 15:06:19.227123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 997/1247] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:18 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:19.590530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:19.591387 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:19.599732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:19.600288 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:19.601216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:19.601763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:19.781407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:19.812303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:19.815013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:19.818614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8c72ea5d-9c22-4b18-a5d8-0c084ad66ec3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.233013 Jun 27 15:06:19.851373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 998/1248] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:19 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:20.234541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c797fb54-c021-40f1-804b-f90606a27cc6 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:20.235156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c797fb54-c021-40f1-804b-f90606a27cc6 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:20.241728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c797fb54-c021-40f1-804b-f90606a27cc6 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:20.242226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c797fb54-c021-40f1-804b-f90606a27cc6 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:20.243128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c797fb54-c021-40f1-804b-f90606a27cc6 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:20.243614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c797fb54-c021-40f1-804b-f90606a27cc6 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:20.396584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c797fb54-c021-40f1-804b-f90606a27cc6 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:20.398182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c797fb54-c021-40f1-804b-f90606a27cc6 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1267 microversion: 2.1 time: 0.167948 Jun 27 15:06:20.398811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 999/1249] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:20 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:20.859275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:20.860769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:20.867651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:20.868072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:20.869458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:20.869925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:21.069666 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:21.081165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:21.082923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:21.090702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-417c46bf-9f06-4590-89ab-4a8e0bd71c6e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.235283 Jun 27 15:06:21.091842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1000/1250] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:20 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:06:21.416786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0886866a-7647-439b-b8a5-549f9238342e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:21.417718 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0886866a-7647-439b-b8a5-549f9238342e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:21.424804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0886866a-7647-439b-b8a5-549f9238342e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:21.425521 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0886866a-7647-439b-b8a5-549f9238342e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:21.426254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0886866a-7647-439b-b8a5-549f9238342e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:21.426717 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0886866a-7647-439b-b8a5-549f9238342e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:21.572791 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0886866a-7647-439b-b8a5-549f9238342e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:21.581087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0886866a-7647-439b-b8a5-549f9238342e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1454 microversion: 2.1 time: 0.169018 Jun 27 15:06:21.581788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1001/1251] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:21 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:06:21.598849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e8f2ae75-f595-4f36-8d72-32830d055d71 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:21.599705 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e8f2ae75-f595-4f36-8d72-32830d055d71 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:21.606141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8f2ae75-f595-4f36-8d72-32830d055d71 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:21.606580 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8f2ae75-f595-4f36-8d72-32830d055d71 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:21.607327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8f2ae75-f595-4f36-8d72-32830d055d71 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:21.607751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e8f2ae75-f595-4f36-8d72-32830d055d71 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:21.748374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e8f2ae75-f595-4f36-8d72-32830d055d71 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:21.756112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e8f2ae75-f595-4f36-8d72-32830d055d71 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1454 microversion: 2.1 time: 0.161128 Jun 27 15:06:21.756799 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1002/1252] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:06:21 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:06:22.114118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:22.114803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:22.124453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:22.124984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:22.125744 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:22.126171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:22.357972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:22.373757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:22.375846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:22.383191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-096d46cf-2f19-4d44-b0df-41148bf76180 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.276333 Jun 27 15:06:22.384498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1003/1253] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:22 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:06:23.402342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:23.403116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:23.410009 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:23.410742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:23.411537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:23.411967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:23.813462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:23.822001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:23.823497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:23.824659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e62ef81d-7aac-41e6-9ca2-6dca5cf44a86 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.427003 Jun 27 15:06:23.825230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1004/1254] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:23 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:24.490189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-5a13874d-4b30-4126-8df8-f679f209742c req-eb2cbef3-a4cc-4312-ba0a-74245765a275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4300d49-751c-4048-bde6-5d4a1d940515", "tag": "6780a0e6-aa6c-4742-b45f-385a5bbf0b86"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:24.502422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5a13874d-4b30-4126-8df8-f679f209742c req-eb2cbef3-a4cc-4312-ba0a-74245765a275 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:24.503153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5a13874d-4b30-4126-8df8-f679f209742c req-eb2cbef3-a4cc-4312-ba0a-74245765a275 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:24.518189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-5a13874d-4b30-4126-8df8-f679f209742c req-eb2cbef3-a4cc-4312-ba0a-74245765a275 service nova] Creating event network-changed:6780a0e6-aa6c-4742-b45f-385a5bbf0b86 for instance a4300d49-751c-4048-bde6-5d4a1d940515 on hv-cinder-79760 Jun 27 15:06:24.523101 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-5a13874d-4b30-4126-8df8-f679f209742c req-eb2cbef3-a4cc-4312-ba0a-74245765a275 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036711 Jun 27 15:06:24.529069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1005/1255] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:06:24.843633 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:24.844319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:24.850411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:24.850858 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:24.851620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:24.854758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:24.871147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:24.996479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:25.004874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:25.006377 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:25.007547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9aba0275-3c89-4db1-b6a0-3ce5c244f5ad tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.168262 Jun 27 15:06:25.008106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1006/1256] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:24 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:26.025240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:26.025909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:26.032562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:26.033056 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:26.033805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:26.034235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:26.164726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:26.172908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:26.174383 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:26.175520 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-546ce429-95d3-412b-aa9b-5a4a52363cc0 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.154264 Jun 27 15:06:26.176100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1007/1257] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:26 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:27.195354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:27.196029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:27.202940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:27.203382 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:27.204133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:27.204557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:27.338442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:27.346404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:27.347795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:27.348965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fb8c7c28-cfb6-4f31-ae4d-26ed63271e3c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1737 microversion: 2.20 time: 0.157573 Jun 27 15:06:27.349520 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1008/1258] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:27 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:28.367159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:28.367872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:28.371429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:28.374846 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:28.375286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:28.376034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:28.376458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:28.512116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:28.520366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:28.521893 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:28.523051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-300bb7ab-85a4-426c-9d48-df6777d3d151 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1719 microversion: 2.20 time: 0.159876 Jun 27 15:06:28.524706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1009/1259] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:28 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:29.543070 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:29.543723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:29.550402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:29.550856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:29.551616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:29.552053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:29.681967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:29.689965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:29.691441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:29.692589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2b0bc5db-5c26-427a-9e8b-1686754ac59b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1719 microversion: 2.20 time: 0.154524 Jun 27 15:06:29.693164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1010/1260] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:29 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:30.711118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:30.711821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:30.718315 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:30.718760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:30.719511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:30.719946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:30.854656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:30.863194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:30.864722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:30.865878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-99747ae2-d0c9-4cf2-9149-66bfcaf6867e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1722 microversion: 2.20 time: 0.158736 Jun 27 15:06:30.866436 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1011/1261] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:30 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:30.882934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b39ea857-d3a2-4006-8b65-4804b0194773 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e54e3ffb-4a52-4006-a583-706f99cb620e"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:30.883978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b39ea857-d3a2-4006-8b65-4804b0194773 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:30.890124 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b39ea857-d3a2-4006-8b65-4804b0194773 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:30.891914 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b39ea857-d3a2-4006-8b65-4804b0194773 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:30.891914 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b39ea857-d3a2-4006-8b65-4804b0194773 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:30.891914 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b39ea857-d3a2-4006-8b65-4804b0194773 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:31.978120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b39ea857-d3a2-4006-8b65-4804b0194773 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.098718 Jun 27 15:06:31.983839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1012/1262] 10.222.0.44 () {62 vars in 1363 bytes} [Mon Jun 27 15:06:30 2022] POST /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/os-volume_attachments => generated 188 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:06:31.989523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-ed795aeb-11ab-4146-9371-f50a4d0a3b9a req-7fae51e5-1c1f-4fab-8bd8-4f6dcab3ab25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d41a61-4384-417c-8b5e-8ddd12ccf67a", "name": "network-vif-unplugged", "status": "completed", "tag": "bef0c110-529a-43f2-91a5-47a11127e1ad"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:31.999102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-ed795aeb-11ab-4146-9371-f50a4d0a3b9a req-7fae51e5-1c1f-4fab-8bd8-4f6dcab3ab25 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:31.999537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-ed795aeb-11ab-4146-9371-f50a4d0a3b9a req-7fae51e5-1c1f-4fab-8bd8-4f6dcab3ab25 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:32.013513 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.compute.server_external_events [req-ed795aeb-11ab-4146-9371-f50a4d0a3b9a req-7fae51e5-1c1f-4fab-8bd8-4f6dcab3ab25 service nova] Unable to find a host for instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a. Dropping event network-vif-unplugged {{(pid=129687) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 15:06:32.013513 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-ed795aeb-11ab-4146-9371-f50a4d0a3b9a req-7fae51e5-1c1f-4fab-8bd8-4f6dcab3ab25 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025709 Jun 27 15:06:32.013513 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1013/1263] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 27 15:06:32.099815 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b471c500-46cd-442c-b213-80269b0725d3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:32.100170 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b471c500-46cd-442c-b213-80269b0725d3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:32.112770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b471c500-46cd-442c-b213-80269b0725d3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:32.113027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b471c500-46cd-442c-b213-80269b0725d3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:32.113699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b471c500-46cd-442c-b213-80269b0725d3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:32.114129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b471c500-46cd-442c-b213-80269b0725d3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:32.731604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b471c500-46cd-442c-b213-80269b0725d3 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/os-volume_attachments/e54e3ffb-4a52-4006-a583-706f99cb620e" status: 202 len: 0 microversion: 2.20 time: 0.636161 Jun 27 15:06:32.732216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1014/1264] 10.222.0.44 () {60 vars in 1456 bytes} [Mon Jun 27 15:06:32 2022] DELETE /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/os-volume_attachments/e54e3ffb-4a52-4006-a583-706f99cb620e => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:06:32.786979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e850243c-c834-41ff-a5b8-c9235df00270 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:32.792601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e850243c-c834-41ff-a5b8-c9235df00270 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:32.794568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e850243c-c834-41ff-a5b8-c9235df00270 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:32.795014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e850243c-c834-41ff-a5b8-c9235df00270 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:32.795775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e850243c-c834-41ff-a5b8-c9235df00270 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:32.796210 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e850243c-c834-41ff-a5b8-c9235df00270 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:33.025689 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e850243c-c834-41ff-a5b8-c9235df00270 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "POST /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/action" status: 202 len: 0 microversion: 2.20 time: 0.242506 Jun 27 15:06:33.030622 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1015/1265] 10.222.0.44 () {62 vars in 1318 bytes} [Mon Jun 27 15:06:32 2022] POST /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:06:33.036305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:33.037112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:33.045923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:33.046506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:33.047373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:33.047873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:33.223196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:33.231298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:33.236716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:33.236716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bedec87c-68e3-484b-ad58-d14242a0d6bb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1670 microversion: 2.20 time: 0.202500 Jun 27 15:06:33.236716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1016/1266] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:33 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1670 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:06:34.252266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:34.252906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:34.259331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:34.259783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:34.260545 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:34.261015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:34.405017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:34.408040 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:34.418931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:34.418931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:34.418931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f17f1809-b04d-4ff7-be75-bfe069dac8c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1672 microversion: 2.20 time: 0.170366 Jun 27 15:06:34.419558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1017/1267] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:34 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:06:35.438519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:35.439234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:35.446516 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:35.446961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:35.447716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:35.448148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:35.581826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:35.589977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:35.591467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:35.592872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c792ecee-5824-4f15-a5d4-a094a65497c2 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.159073 Jun 27 15:06:35.598188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1018/1268] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:35 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:06:36.615342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:36.616816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:36.626372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:36.627232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:36.628094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:36.628622 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:36.784811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:36.800135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:36.801673 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:36.802835 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a2562f3a-1497-4057-8302-e65b6730e486 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.191956 Jun 27 15:06:36.803395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1019/1269] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:36 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:06:37.822300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:37.822981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:37.830730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:37.831173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:37.831925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:37.832352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:37.974079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:37.982600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:37.984467 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:37.985701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a9f00166-a96f-46ae-92b2-f71308700995 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.167479 Jun 27 15:06:37.986670 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1020/1270] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:37 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:39.004527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:39.005153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:39.012925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:39.013618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:39.014714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:39.015336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:39.196967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:39.205257 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:39.207063 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:39.208430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3c46e6b5-6dc2-4f4a-a344-56398fa0cde4 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.208962 Jun 27 15:06:39.209385 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1021/1271] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:38 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:40.230852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:40.231725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:40.240684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:40.241182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:40.244460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:40.244460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:40.399726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:40.411572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:40.417143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:40.418597 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6ebda36c-a085-4716-bcb8-bdcbcc0d0ebb tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.194813 Jun 27 15:06:40.419236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1022/1272] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:40 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:41.438671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:41.439359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:41.446223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:41.451024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:41.451024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:41.451024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:41.586684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:41.597223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:41.598726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:41.600134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-747c40dd-a28d-495d-ba00-21c0514c860e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.165928 Jun 27 15:06:41.600587 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1023/1273] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:41 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:42.619852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:42.620725 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:42.627599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:42.628049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:42.628850 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:42.629283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:42.767331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:42.775454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:42.777297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:42.778473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bbe1645f-e6e4-4c90-b4f7-333cfd4c92b8 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.162918 Jun 27 15:06:42.779179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1024/1274] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:42 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:43.799645 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:43.801175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:43.808407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:43.808978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:43.809750 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:43.810183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:43.955633 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:43.964123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:43.965684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:43.972503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ad77792d-4850-49bb-a130-5a0a81e0606e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.172621 Jun 27 15:06:43.972503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1025/1275] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:43 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:44.986288 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:44.987020 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:44.993771 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:44.994212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:44.996214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:44.996214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:45.150664 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:45.160057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:45.161598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:45.162780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-24e6b28b-33d5-4d86-bddb-1b5b73572dd6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.180887 Jun 27 15:06:45.164732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1026/1276] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:44 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:46.181271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:46.181876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:46.189786 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:46.190224 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:46.190974 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:46.191403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:46.326625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:46.334518 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:46.336014 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:46.337196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e57472f6-f7dd-4028-b1e1-337ce358df7b tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.160004 Jun 27 15:06:46.337753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1027/1277] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:46 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:47.361006 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:47.361678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:47.367915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:47.368359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:47.369125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:47.369555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:47.503071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:47.511171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:47.512899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:47.514111 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b91b5067-b699-466a-9536-378d3c6561e6 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.157124 Jun 27 15:06:47.514842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1028/1278] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:47 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:48.532504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:48.533408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:48.539398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:48.539837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:48.540582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:48.541170 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:48.716178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:48.725606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:48.727115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:48.728276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a51e735f-4250-4c01-8874-1cbf2e185be5 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.199946 Jun 27 15:06:48.728882 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1029/1279] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:48 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:49.746779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:49.747463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:49.754125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:49.754576 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:49.755339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:49.755772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:49.895733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:49.903896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:49.906069 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:49.907325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6431834e-72b7-438a-ad3d-3cd6d83b3f6c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.164664 Jun 27 15:06:49.907957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1030/1280] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:49 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:50.930951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:50.931537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:50.939056 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:50.939503 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:50.940261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:50.940716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:51.081158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:51.089708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:51.091516 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:51.093228 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0d419023-44e5-4b2e-addb-2f85fdbbb8ec tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.166488 Jun 27 15:06:51.093805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1031/1281] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:50 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:06:52.111746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:52.112346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:52.118581 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:52.119033 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:52.119787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:52.120225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:52.254175 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:52.262238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:52.263733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:52.265774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-eed37c9e-1986-4cdf-9c69-0f380cab4262 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.158430 Jun 27 15:06:52.266537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1032/1282] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:52 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:53.285155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:53.285785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:53.292293 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:53.292757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:53.293522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:53.293960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:53.428912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:53.437566 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:53.439088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:53.440284 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-36938861-175c-49ac-97aa-5b16df0c4c51 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.159288 Jun 27 15:06:53.440883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1033/1283] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:53 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:53.790730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-a1c73418-041e-4e8f-ba3d-2f21b501caa1 req-f624444e-4965-4608-bbd8-d5bb1521cf3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d41a61-4384-417c-8b5e-8ddd12ccf67a", "name": "network-vif-plugged", "status": "completed", "tag": "bef0c110-529a-43f2-91a5-47a11127e1ad"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:06:53.798760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-a1c73418-041e-4e8f-ba3d-2f21b501caa1 req-f624444e-4965-4608-bbd8-d5bb1521cf3b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:53.799200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-a1c73418-041e-4e8f-ba3d-2f21b501caa1 req-f624444e-4965-4608-bbd8-d5bb1521cf3b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:53.809977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-a1c73418-041e-4e8f-ba3d-2f21b501caa1 req-f624444e-4965-4608-bbd8-d5bb1521cf3b service nova] Creating event network-vif-plugged:bef0c110-529a-43f2-91a5-47a11127e1ad for instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a on hv-cinder-79760 Jun 27 15:06:53.815440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-a1c73418-041e-4e8f-ba3d-2f21b501caa1 req-f624444e-4965-4608-bbd8-d5bb1521cf3b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028230 Jun 27 15:06:53.816076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1034/1284] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:06:54.459161 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:54.459852 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:54.466192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:54.466636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:54.467385 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:54.467845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:54.471755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=100 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:54.597590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:54.605522 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:54.607011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:54.608148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d5cede47-8971-412e-8d72-796c90369970 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.153866 Jun 27 15:06:54.608713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1035/1285] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:54 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:55.627968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:55.628608 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:55.634798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:55.636870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:55.636870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:55.636870 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:55.768386 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:55.776408 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:55.777964 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:55.779166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bf0c3a44-9e70-411e-a2b8-6a0c96ebb443 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.156044 Jun 27 15:06:55.779766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1036/1286] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:55 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:56.797412 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:56.798113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:56.804871 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:56.805577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:56.806422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:56.806865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:56.945763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:56.955339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:56.957231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:56.958348 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-de629f4f-6f1a-4088-977a-683f2242c139 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1728 microversion: 2.20 time: 0.164751 Jun 27 15:06:56.958903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1037/1287] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:56 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:06:57.976740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:06:57.977414 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:06:57.983869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:57.984306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:57.985086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:06:57.985515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:06:58.117415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:58.125527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:58.128164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:06:58.129381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3cb013be-ec73-4345-92c5-432aac07117f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1715 microversion: 2.20 time: 0.156750 Jun 27 15:06:58.129945 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1038/1288] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:06:57 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:07:34.059463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-da7c3a0f-3fc7-47b9-8982-d1f9b5c6e821 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:34.060216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-da7c3a0f-3fc7-47b9-8982-d1f9b5c6e821 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:34.062610 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=60 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:07:34.063281 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=23 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:07:34.068212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-da7c3a0f-3fc7-47b9-8982-d1f9b5c6e821 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:34.068693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-da7c3a0f-3fc7-47b9-8982-d1f9b5c6e821 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:34.069464 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-da7c3a0f-3fc7-47b9-8982-d1f9b5c6e821 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:34.069955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-da7c3a0f-3fc7-47b9-8982-d1f9b5c6e821 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:34.094264 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-da7c3a0f-3fc7-47b9-8982-d1f9b5c6e821 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/ips" status: 200 len: 149 microversion: 2.1 time: 0.038800 Jun 27 15:07:34.095691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1039/1289] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:07:34 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:07:35.623707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3100a343-fa4e-4fe6-bd03-fee4f2372d55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a382881-6252-4f93-962a-b947eb4999c9"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:07:35.624797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3100a343-fa4e-4fe6-bd03-fee4f2372d55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:35.632013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3100a343-fa4e-4fe6-bd03-fee4f2372d55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:35.632454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3100a343-fa4e-4fe6-bd03-fee4f2372d55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:35.633255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3100a343-fa4e-4fe6-bd03-fee4f2372d55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:35.633679 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3100a343-fa4e-4fe6-bd03-fee4f2372d55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:36.301207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3100a343-fa4e-4fe6-bd03-fee4f2372d55 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "POST /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681491 Jun 27 15:07:36.301739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1040/1290] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:07:35 2022] POST /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:07:43.878058 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b0c027af-5301-430d-8a9b-025336b27506 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:43.878971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b0c027af-5301-430d-8a9b-025336b27506 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:43.885189 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0c027af-5301-430d-8a9b-025336b27506 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:43.898135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0c027af-5301-430d-8a9b-025336b27506 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:43.898135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0c027af-5301-430d-8a9b-025336b27506 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:43.898135 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b0c027af-5301-430d-8a9b-025336b27506 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:43.968173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-b0c027af-5301-430d-8a9b-025336b27506 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lazy-loading 'services' on Instance uuid 2255225e-ba1f-4556-8318-3caa2363e02b {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:07:44.153097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b0c027af-5301-430d-8a9b-025336b27506 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments/1a382881-6252-4f93-962a-b947eb4999c9" status: 202 len: 0 microversion: 2.1 time: 0.279873 Jun 27 15:07:44.153693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1041/1291] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:07:43 2022] DELETE /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments/1a382881-6252-4f93-962a-b947eb4999c9 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:07:44.162211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-54b055b8-0dd9-438f-9d0b-898252aeeb67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:44.163271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-54b055b8-0dd9-438f-9d0b-898252aeeb67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:44.169460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54b055b8-0dd9-438f-9d0b-898252aeeb67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:44.173428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54b055b8-0dd9-438f-9d0b-898252aeeb67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:44.173428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54b055b8-0dd9-438f-9d0b-898252aeeb67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:44.173428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54b055b8-0dd9-438f-9d0b-898252aeeb67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:44.200638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-54b055b8-0dd9-438f-9d0b-898252aeeb67 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042525 Jun 27 15:07:44.201208 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1042/1292] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:07:44 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:07:45.212077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-41c069f3-73e5-443f-8338-0381c4245ebc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:45.212956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-41c069f3-73e5-443f-8338-0381c4245ebc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:45.219289 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41c069f3-73e5-443f-8338-0381c4245ebc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:45.219737 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41c069f3-73e5-443f-8338-0381c4245ebc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:45.220501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41c069f3-73e5-443f-8338-0381c4245ebc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:45.220989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-41c069f3-73e5-443f-8338-0381c4245ebc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:45.249866 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-41c069f3-73e5-443f-8338-0381c4245ebc tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041848 Jun 27 15:07:45.250591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1043/1293] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:07:45 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:07:46.261486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7606e097-cb87-49f6-be2d-853096cfbed0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:46.262397 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7606e097-cb87-49f6-be2d-853096cfbed0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:46.269526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7606e097-cb87-49f6-be2d-853096cfbed0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:46.269971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7606e097-cb87-49f6-be2d-853096cfbed0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:46.270724 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7606e097-cb87-49f6-be2d-853096cfbed0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:46.271157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7606e097-cb87-49f6-be2d-853096cfbed0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:46.299192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7606e097-cb87-49f6-be2d-853096cfbed0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041673 Jun 27 15:07:46.299734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1044/1294] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:07:46 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:07:46.356496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-87ab26ac-85f5-4bdd-b74c-906a1925cc73 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:46.357057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-87ab26ac-85f5-4bdd-b74c-906a1925cc73 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:46.363093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87ab26ac-85f5-4bdd-b74c-906a1925cc73 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:46.363527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87ab26ac-85f5-4bdd-b74c-906a1925cc73 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:46.364271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87ab26ac-85f5-4bdd-b74c-906a1925cc73 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:46.364726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-87ab26ac-85f5-4bdd-b74c-906a1925cc73 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:46.388764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-87ab26ac-85f5-4bdd-b74c-906a1925cc73 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:07:46.667987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-87ab26ac-85f5-4bdd-b74c-906a1925cc73 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 204 len: 0 microversion: 2.1 time: 0.314929 Jun 27 15:07:46.668581 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1045/1295] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:07:46 2022] DELETE /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:07:46.677561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a803a37b-c0cc-468d-946c-5eb9f66b6baf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:46.678256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a803a37b-c0cc-468d-946c-5eb9f66b6baf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:46.684391 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a803a37b-c0cc-468d-946c-5eb9f66b6baf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:46.684875 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a803a37b-c0cc-468d-946c-5eb9f66b6baf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:46.685624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a803a37b-c0cc-468d-946c-5eb9f66b6baf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:46.686059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a803a37b-c0cc-468d-946c-5eb9f66b6baf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:46.816325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a803a37b-c0cc-468d-946c-5eb9f66b6baf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:46.823755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a803a37b-c0cc-468d-946c-5eb9f66b6baf tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1681 microversion: 2.1 time: 0.150919 Jun 27 15:07:46.824321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1046/1296] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:07:46 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:07:47.841478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4c40abaf-d6db-479c-a87b-ebfea49aa499 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:47.842269 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4c40abaf-d6db-479c-a87b-ebfea49aa499 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:47.849124 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c40abaf-d6db-479c-a87b-ebfea49aa499 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:47.849565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c40abaf-d6db-479c-a87b-ebfea49aa499 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:47.850302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c40abaf-d6db-479c-a87b-ebfea49aa499 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:47.850731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4c40abaf-d6db-479c-a87b-ebfea49aa499 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:47.979734 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4c40abaf-d6db-479c-a87b-ebfea49aa499 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:47.987747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4c40abaf-d6db-479c-a87b-ebfea49aa499 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1681 microversion: 2.1 time: 0.149447 Jun 27 15:07:47.988403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1047/1297] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:07:47 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:07:49.005592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-048af71e-9451-4626-b978-a67359ffae31 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:49.006254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-048af71e-9451-4626-b978-a67359ffae31 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:49.012554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048af71e-9451-4626-b978-a67359ffae31 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:49.013032 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048af71e-9451-4626-b978-a67359ffae31 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:49.013789 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048af71e-9451-4626-b978-a67359ffae31 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:49.014216 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-048af71e-9451-4626-b978-a67359ffae31 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:49.149035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-048af71e-9451-4626-b978-a67359ffae31 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:49.156593 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-048af71e-9451-4626-b978-a67359ffae31 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1681 microversion: 2.1 time: 0.155646 Jun 27 15:07:49.159253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1048/1298] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:07:48 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:07:50.128611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-3bb99ff2-6868-4f8f-a109-6d184a271cf2 req-62076b27-8e2a-4d57-b30a-7a088a4f74ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2255225e-ba1f-4556-8318-3caa2363e02b", "name": "network-vif-deleted", "tag": "aad5dc86-8889-4b5e-9174-c330ac49ed21"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:07:50.137710 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-3bb99ff2-6868-4f8f-a109-6d184a271cf2 req-62076b27-8e2a-4d57-b30a-7a088a4f74ff service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:50.138186 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-3bb99ff2-6868-4f8f-a109-6d184a271cf2 req-62076b27-8e2a-4d57-b30a-7a088a4f74ff service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:50.149546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-3bb99ff2-6868-4f8f-a109-6d184a271cf2 req-62076b27-8e2a-4d57-b30a-7a088a4f74ff service nova] Creating event network-vif-deleted:aad5dc86-8889-4b5e-9174-c330ac49ed21 for instance 2255225e-ba1f-4556-8318-3caa2363e02b on hv-cinder-79760 Jun 27 15:07:50.154341 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-3bb99ff2-6868-4f8f-a109-6d184a271cf2 req-62076b27-8e2a-4d57-b30a-7a088a4f74ff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229916 Jun 27 15:07:50.155131 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1049/1299] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:07:50.175769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7b63ef50-497b-4aec-972d-2bc6e4ae52b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:50.176591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7b63ef50-497b-4aec-972d-2bc6e4ae52b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:50.183092 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b63ef50-497b-4aec-972d-2bc6e4ae52b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:50.183538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b63ef50-497b-4aec-972d-2bc6e4ae52b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:50.184375 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b63ef50-497b-4aec-972d-2bc6e4ae52b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:50.184841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b63ef50-497b-4aec-972d-2bc6e4ae52b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:50.251508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7b63ef50-497b-4aec-972d-2bc6e4ae52b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93abd4361d240919ec85cf4b92347fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d96ee908883411d9838f850ee7dd66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:50.260336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7b63ef50-497b-4aec-972d-2bc6e4ae52b9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 200 len: 1327 microversion: 2.1 time: 0.089787 Jun 27 15:07:50.260872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1050/1300] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:07:50 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 1327 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:07:51.277619 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:51.278238 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:51.285211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:51.285650 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:51.286395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:51.286821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:51.300064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b HTTP/1.1 Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:51.301813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:51.303508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '2255225e-ba1f-4556-8318-3caa2363e02b'} Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:51.304823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:51.306416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:51.307780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:51.307780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9b8ccc6c-a495-449d-a2f8-304e1599d607 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 404 len: 111 microversion: 2.1 time: 0.029547 Jun 27 15:07:51.307780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1051/1301] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:07:51 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:07:51.311621 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e46aaaa0-ac3d-4b0c-b490-80de65d2c1df tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '.version_select at 0x7f13f94fcee0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:51.372206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e46aaaa0-ac3d-4b0c-b490-80de65d2c1df tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091920599" status: 202 len: 0 microversion: 2.1 time: 0.063878 Jun 27 15:07:51.372962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1052/1302] 10.222.0.44 () {58 vars in 1220 bytes} [Mon Jun 27 15:07:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091920599 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:07:53.446642 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:53.447275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:53.453821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:53.454265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:53.455011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:53.455447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:53.468098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b HTTP/1.1 Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:53.469648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.471260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '2255225e-ba1f-4556-8318-3caa2363e02b'} Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:53.472215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.473535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.474785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:53.474785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e4b95976-a269-49a8-bb49-c1e9f0886c49 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 404 len: 111 microversion: 2.1 time: 0.028844 Jun 27 15:07:53.474785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1053/1303] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:07:53 2022] DELETE /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:07:53.478889 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:53.479488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 2255225e-ba1f-4556-8318-3caa2363e02b] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:53.485022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:53.485496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:53.486239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:53.486668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:53.499940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b HTTP/1.1 Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:53.501456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.503544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '2255225e-ba1f-4556-8318-3caa2363e02b'} Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:53.504404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. Jun 27 15:07:53.505921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:53.507427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance 2255225e-ba1f-4556-8318-3caa2363e02b could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:53.507427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2a0f785a-d6d6-49b8-9ebd-4c5946ce8b83 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b" status: 404 len: 111 microversion: 2.1 time: 0.027385 Jun 27 15:07:53.507427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1054/1304] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:07:53 2022] GET /compute/v2.1/servers/2255225e-ba1f-4556-8318-3caa2363e02b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:07:53.629369 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7695da61-fef7-4210-ad1d-a1697888d345 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:53.630264 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7695da61-fef7-4210-ad1d-a1697888d345 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:53.636034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7695da61-fef7-4210-ad1d-a1697888d345 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:53.636478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7695da61-fef7-4210-ad1d-a1697888d345 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:53.637256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7695da61-fef7-4210-ad1d-a1697888d345 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:53.637682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7695da61-fef7-4210-ad1d-a1697888d345 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:53.662592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:07:53.666791 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7695da61-fef7-4210-ad1d-a1697888d345 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042044 Jun 27 15:07:53.667333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1055/1305] 10.222.0.44 () {60 vars in 1342 bytes} [Mon Jun 27 15:07:53 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:07:53.730470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f69e9881-53fa-4d20-b031-8f006445848c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:53.730961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f69e9881-53fa-4d20-b031-8f006445848c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:53.738489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f69e9881-53fa-4d20-b031-8f006445848c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:53.738935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f69e9881-53fa-4d20-b031-8f006445848c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:53.739694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f69e9881-53fa-4d20-b031-8f006445848c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:53.740127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f69e9881-53fa-4d20-b031-8f006445848c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:53.765063 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f69e9881-53fa-4d20-b031-8f006445848c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:07:54.034296 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f69e9881-53fa-4d20-b031-8f006445848c tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 204 len: 0 microversion: 2.20 time: 0.307249 Jun 27 15:07:54.035116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1056/1306] 10.222.0.44 () {60 vars in 1279 bytes} [Mon Jun 27 15:07:53 2022] DELETE /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 27 15:07:54.043367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:54.044129 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:54.050963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.051402 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.052222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.052719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.189215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:54.197469 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:54.198958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:54.201571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2fce2e56-47ac-44d9-b050-038f5702dc4a tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.160732 Jun 27 15:07:54.201571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1057/1307] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:07:54 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:07:54.774655 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:54.775253 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:54.781588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.782039 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.782796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.783231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.796636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea HTTP/1.1 Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:54.798330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.799910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '0f842ec7-32eb-4898-8b26-dbb78e4616ea'} Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:54.800845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.802206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.803720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:54.803720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7e669a6a-0282-4a5c-bbbd-711754e3dcd5 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 404 len: 111 microversion: 2.1 time: 0.029149 Jun 27 15:07:54.803720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1058/1308] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:07:54 2022] DELETE /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:07:54.808191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:54.808828 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 0f842ec7-32eb-4898-8b26-dbb78e4616ea] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:54.814313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.814757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.816419 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.816973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.829831 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea HTTP/1.1 Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:54.832403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.834097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '0f842ec7-32eb-4898-8b26-dbb78e4616ea'} Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:54.834899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. Jun 27 15:07:54.836138 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.837302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance 0f842ec7-32eb-4898-8b26-dbb78e4616ea could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:54.837302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f393a0f7-fcaa-451a-a020-b55453bb60f9 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea" status: 404 len: 111 microversion: 2.1 time: 0.029068 Jun 27 15:07:54.837302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1059/1309] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:07:54 2022] GET /compute/v2.1/servers/0f842ec7-32eb-4898-8b26-dbb78e4616ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:07:54.841488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:54.841976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:54.847880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.848328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.849118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.849556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.862766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 HTTP/1.1 Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:54.864303 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.865957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'bdc6fa5c-6fa8-4071-a3c0-b52e14b64164'} Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:54.866931 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.868524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.870085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:54.870085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-82d707d5-2bbf-49dd-a02c-144bad377305 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 404 len: 111 microversion: 2.1 time: 0.027693 Jun 27 15:07:54.870085 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1060/1310] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:07:54 2022] DELETE /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:07:54.873506 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:54.874105 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: bdc6fa5c-6fa8-4071-a3c0-b52e14b64164] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:54.880546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.881018 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.881770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:54.882203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:54.896019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 HTTP/1.1 Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:54.897544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.899113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'bdc6fa5c-6fa8-4071-a3c0-b52e14b64164'} Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:54.900004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. Jun 27 15:07:54.901508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:54.902816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:54.902816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7383be5f-a254-4319-8472-bda1cd3ecdeb tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164" status: 404 len: 111 microversion: 2.1 time: 0.029170 Jun 27 15:07:54.902816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1061/1311] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:07:54 2022] GET /compute/v2.1/servers/bdc6fa5c-6fa8-4071-a3c0-b52e14b64164 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:07:55.217987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:55.218592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:55.224484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:55.224956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:55.225706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:55.226133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:55.353301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:55.361184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:55.363252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:55.364407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9ef3ff94-224c-43b1-9acd-ac5a4a09f937 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1721 microversion: 2.20 time: 0.150364 Jun 27 15:07:55.365003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1062/1312] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:07:55 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:07:56.183992 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:56.184634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:56.191618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:56.192005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:56.192900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:56.193207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:56.207024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc HTTP/1.1 Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:56.208631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.210081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '31fe8f1e-a283-4606-bc7f-fc3900da88fc'} Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:56.210996 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.212607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.214267 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:56.214267 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a34d1de9-20bd-4aff-a663-ae049af1fff0 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "DELETE /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 404 len: 111 microversion: 2.1 time: 0.029905 Jun 27 15:07:56.214267 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1063/1313] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:07:56 2022] DELETE /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:07:56.217988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:56.218589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] [instance: 31fe8f1e-a283-4606-bc7f-fc3900da88fc] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:56.224738 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:56.226139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:56.226139 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:56.226347 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:56.240062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] HTTP exception thrown: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Request method failure captured: Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc HTTP/1.1 Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT2W2BLjcjWAE-eso7nFykqZcoW8CwmukyM7QVrehhEXYLmcrDMVRA6Nq1-BiKJWhPYpzLPOfWSVskQuJRfQpihHuqUeBLyZCOK5icsSdI_2tfUB2gF7u265H-34kFmBcDU8Uhis1SQsRL9m3ptvz4aAfuLNILO4UrRGA2MiXSoVpY Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:56.241640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d96ee908883411d9838f850ee7dd66b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 3d96ee908883411d9838f850ee7dd66b Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1987653938 Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: d93abd4361d240919ec85cf4b92347fb Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeNegativeTest-1987653938-project Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.243607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '31fe8f1e-a283-4606-bc7f-fc3900da88fc'} Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:56.244690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. Jun 27 15:07:56.246076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:56.247605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] Returning 404 to user: Instance 31fe8f1e-a283-4606-bc7f-fc3900da88fc could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:56.247605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9bc60b82-85a0-4035-a013-a8c572ef9522 tempest-AttachVolumeNegativeTest-1987653938 tempest-AttachVolumeNegativeTest-1987653938-project] 10.222.0.44 "GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc" status: 404 len: 111 microversion: 2.1 time: 0.028575 Jun 27 15:07:56.247605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1064/1314] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:07:56 2022] GET /compute/v2.1/servers/31fe8f1e-a283-4606-bc7f-fc3900da88fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:07:56.382914 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:56.385504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:56.389740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:56.390406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:56.391167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:56.391799 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:56.488613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:56.497911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:56.499407 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:56.500817 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e5d4cbce-7ea2-4594-915a-d57b7c1de00f tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1654 microversion: 2.20 time: 0.121970 Jun 27 15:07:56.501372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1065/1315] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:07:56 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1654 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:07:56.626711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-4425ae74-3d59-4ee0-8cde-f5e3d4d35ec8 req-3c48920a-50f9-4010-8e6c-8f94f4d96e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d41a61-4384-417c-8b5e-8ddd12ccf67a", "name": "network-vif-deleted", "tag": "bef0c110-529a-43f2-91a5-47a11127e1ad"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:07:56.640275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-4425ae74-3d59-4ee0-8cde-f5e3d4d35ec8 req-3c48920a-50f9-4010-8e6c-8f94f4d96e7d service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:56.640843 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-4425ae74-3d59-4ee0-8cde-f5e3d4d35ec8 req-3c48920a-50f9-4010-8e6c-8f94f4d96e7d service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:56.652896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-4425ae74-3d59-4ee0-8cde-f5e3d4d35ec8 req-3c48920a-50f9-4010-8e6c-8f94f4d96e7d service nova] Creating event network-vif-deleted:bef0c110-529a-43f2-91a5-47a11127e1ad for instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a on hv-cinder-79760 Jun 27 15:07:56.657892 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-4425ae74-3d59-4ee0-8cde-f5e3d4d35ec8 req-3c48920a-50f9-4010-8e6c-8f94f4d96e7d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038811 Jun 27 15:07:56.659016 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1066/1316] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:07:57.521872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:57.522565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:57.532967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:57.532967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:57.532967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:57.533376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:57.571292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:57.571822 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:57.572346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lazy-loading 'fault' on Instance uuid d8d41a61-4384-417c-8b5e-8ddd12ccf67a {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:07:57.635150 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:57.643283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:57.653612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e7fc2290a641bcb6f1f96501f98d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e1b27eb6724262b7a128c8412642d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:07:57.653612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-568d3a42-d42c-49b2-8353-71a25a3e79df tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 200 len: 1371 microversion: 2.20 time: 0.130031 Jun 27 15:07:57.653612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1067/1317] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:07:57 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 1371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:07:58.664746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:58.665364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:07:58.672637 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:58.673112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:58.673884 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:07:58.675198 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:07:58.692035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] HTTP exception thrown: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Request method failure captured: Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a HTTP/1.1 Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT6E8qpbFeunhO3-eUzigTzl-EQ8nuUJ-3z2888iRcGaF8qzwpz0yaRnITkRqtNDFP8nS2r05WKAd04cbsv5Tx38-a_OSpbuokT_GrUWuuy7eCYqv9S_NhDoZxp-3TWYF9KAQqOBY0MmGCvUSTtQyiy0C9kOqD27-qWCPwm8LCegv0 Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:07:58.693731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 29e7fc2290a641bcb6f1f96501f98d69 Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:07:58.695400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'd8d41a61-4384-417c-8b5e-8ddd12ccf67a'} Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:07:58.696182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:07:58.697550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:07:58.700922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Returning 404 to user: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:07:58.703037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c492acba-c91e-4f53-8851-9176929a8956 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 404 len: 111 microversion: 2.20 time: 0.042768 Jun 27 15:07:58.708693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1068/1318] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:07:58 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:07:58.714393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7b51b019-09ba-46ed-867b-97fe56776d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '.version_select at 0x7f13fe31d700>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:07:58.847059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7b51b019-09ba-46ed-867b-97fe56776d4d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429814664" status: 204 len: 0 microversion: 2.20 time: 0.136152 Jun 27 15:07:58.847651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1069/1319] 10.222.0.44 () {60 vars in 1258 bytes} [Mon Jun 27 15:07:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429814664 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 15:08:00.968231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:00.968847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:00.976967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:00.977449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:00.978286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:00.979373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:00.995115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] HTTP exception thrown: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Request method failure captured: Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a HTTP/1.1 Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT6E8qpbFeunhO3-eUzigTzl-EQ8nuUJ-3z2888iRcGaF8qzwpz0yaRnITkRqtNDFP8nS2r05WKAd04cbsv5Tx38-a_OSpbuokT_GrUWuuy7eCYqv9S_NhDoZxp-3TWYF9KAQqOBY0MmGCvUSTtQyiy0C9kOqD27-qWCPwm8LCegv0 Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:00.996927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 29e7fc2290a641bcb6f1f96501f98d69 Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:00.998707 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'd8d41a61-4384-417c-8b5e-8ddd12ccf67a'} Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:00.999649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:01.001234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:01.003107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Returning 404 to user: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:01.003323 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b1f8f79a-236e-4af2-840c-5e58d76aa13e tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 404 len: 111 microversion: 2.20 time: 0.039984 Jun 27 15:08:01.004122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1070/1320] 10.222.0.44 () {60 vars in 1279 bytes} [Mon Jun 27 15:08:00 2022] DELETE /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:08:01.012234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:01.012877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d8d41a61-4384-417c-8b5e-8ddd12ccf67a] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:01.019790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:01.020298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:01.021259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:01.021692 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:01.038638 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] HTTP exception thrown: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Request method failure captured: Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a HTTP/1.1 Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT6E8qpbFeunhO3-eUzigTzl-EQ8nuUJ-3z2888iRcGaF8qzwpz0yaRnITkRqtNDFP8nS2r05WKAd04cbsv5Tx38-a_OSpbuokT_GrUWuuy7eCYqv9S_NhDoZxp-3TWYF9KAQqOBY0MmGCvUSTtQyiy0C9kOqD27-qWCPwm8LCegv0 Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:01.040183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 29e7fc2290a641bcb6f1f96501f98d69 Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:01.042004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'd8d41a61-4384-417c-8b5e-8ddd12ccf67a'} Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:01.045928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. Jun 27 15:08:01.047452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:01.050620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Returning 404 to user: Instance d8d41a61-4384-417c-8b5e-8ddd12ccf67a could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:01.050620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8431adfd-d4df-46a9-b1cd-4001d029d507 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a" status: 404 len: 111 microversion: 2.20 time: 0.033420 Jun 27 15:08:01.050620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1071/1321] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:08:01 2022] GET /compute/v2.1/servers/d8d41a61-4384-417c-8b5e-8ddd12ccf67a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:08:02.121494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ced3d7ec-dd2f-4340-9b4b-527e7374611f tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Action: 'create', calling method: .version_select at 0x7f13fe31d310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-628377809"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:02.738201 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ced3d7ec-dd2f-4340-9b4b-527e7374611f tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.731521 Jun 27 15:08:02.738866 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1072/1322] 10.222.0.44 () {60 vars in 1154 bytes} [Mon Jun 27 15:08:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 733 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 27 15:08:02.743702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:02.744184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:02.751299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:02.751733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:02.752478 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:02.752929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:02.766570 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] HTTP exception thrown: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Request method failure captured: Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 HTTP/1.1 Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT6E8qpbFeunhO3-eUzigTzl-EQ8nuUJ-3z2888iRcGaF8qzwpz0yaRnITkRqtNDFP8nS2r05WKAd04cbsv5Tx38-a_OSpbuokT_GrUWuuy7eCYqv9S_NhDoZxp-3TWYF9KAQqOBY0MmGCvUSTtQyiy0C9kOqD27-qWCPwm8LCegv0 Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:02.768270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 29e7fc2290a641bcb6f1f96501f98d69 Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.776325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'd67eac8a-bfba-489d-8d6d-11956e1b4e90'} Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:02.777280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.778904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.780595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Returning 404 to user: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:02.780595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9ae8c80a-5cd3-4fa8-a5c3-84de073bb41d tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 404 len: 111 microversion: 2.20 time: 0.029846 Jun 27 15:08:02.780595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1073/1323] 10.222.0.44 () {60 vars in 1279 bytes} [Mon Jun 27 15:08:02 2022] DELETE /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:08:02.780595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f9070353-85b6-4f0b-978b-4804047dabba tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f95dcb80>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:02.830367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f9070353-85b6-4f0b-978b-4804047dabba tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655" status: 200 len: 344 microversion: 2.1 time: 0.059173 Jun 27 15:08:02.831173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1074/1324] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:02 2022] GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:08:02.836704 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:02.843533 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] [instance: d67eac8a-bfba-489d-8d6d-11956e1b4e90] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:02.843533 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:02.843881 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:02.844591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:02.845047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:02.858314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] HTTP exception thrown: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Request method failure captured: Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 HTTP/1.1 Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucT6E8qpbFeunhO3-eUzigTzl-EQ8nuUJ-3z2888iRcGaF8qzwpz0yaRnITkRqtNDFP8nS2r05WKAd04cbsv5Tx38-a_OSpbuokT_GrUWuuy7eCYqv9S_NhDoZxp-3TWYF9KAQqOBY0MmGCvUSTtQyiy0C9kOqD27-qWCPwm8LCegv0 Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:02.859987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93e1b27eb6724262b7a128c8412642d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 93e1b27eb6724262b7a128c8412642d6 Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685718136 Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 29e7fc2290a641bcb6f1f96501f98d69 Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685718136-project Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.861844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'd67eac8a-bfba-489d-8d6d-11956e1b4e90'} Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:02.862941 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. Jun 27 15:08:02.864481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:02.866448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] Returning 404 to user: Instance d67eac8a-bfba-489d-8d6d-11956e1b4e90 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:02.866448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0fab07cb-635d-4f6d-a102-88e8cf0ca799 tempest-AttachVolumeShelveTestJSON-685718136 tempest-AttachVolumeShelveTestJSON-685718136-project] 10.222.0.44 "GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90" status: 404 len: 111 microversion: 2.20 time: 0.029166 Jun 27 15:08:02.866448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1075/1325] 10.222.0.44 () {60 vars in 1276 bytes} [Mon Jun 27 15:08:02 2022] GET /compute/v2.1/servers/d67eac8a-bfba-489d-8d6d-11956e1b4e90 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:08:03.843344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5dfffbeb-e9ef-4b23-a0e9-a2414cf395af tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13fe31d670>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:03.888550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5dfffbeb-e9ef-4b23-a0e9-a2414cf395af tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655" status: 200 len: 345 microversion: 2.1 time: 0.049045 Jun 27 15:08:03.889127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1076/1326] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:03 2022] GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:03.900371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a1c96f4f-7f85-4e1e-81d1-0b78337a5dc4 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Action: 'create', calling method: .version_select at 0x7f13f94fc280>, body: {"snapshot": {"volume_id": "9a856814-a1cb-4c21-9bbb-481f87c78655", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-259981206"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:04.384517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a1c96f4f-7f85-4e1e-81d1-0b78337a5dc4 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.488333 Jun 27 15:08:04.385338 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1077/1327] 10.222.0.44 () {60 vars in 1161 bytes} [Mon Jun 27 15:08:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:04.398116 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cbc7526f-fbe2-44e4-99f3-1b0a93cc742f tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f9659d30>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:04.440928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cbc7526f-fbe2-44e4-99f3-1b0a93cc742f tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 200 len: 286 microversion: 2.1 time: 0.049056 Jun 27 15:08:04.441780 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1078/1328] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:08:04 2022] GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:08:04.451364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a9f1912d-25cd-4961-bd54-5b27ee9b1153 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f96574c0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:04.484764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a9f1912d-25cd-4961-bd54-5b27ee9b1153 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037125 Jun 27 15:08:04.490953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1079/1329] 10.222.0.44 () {58 vars in 1139 bytes} [Mon Jun 27 15:08:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:04.496473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-57d9ad13-e1c5-4ebf-81db-1a0e50265947 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f9f0c3a0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:04.530781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-57d9ad13-e1c5-4ebf-81db-1a0e50265947 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 200 len: 286 microversion: 2.1 time: 0.038163 Jun 27 15:08:04.531335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1080/1330] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:08:04 2022] GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:05.543645 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8fb72fe4-6e7f-470c-8eb3-776287297e1d tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f960d9d0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:05.572929 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8fb72fe4-6e7f-470c-8eb3-776287297e1d tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 200 len: 286 microversion: 2.1 time: 0.033530 Jun 27 15:08:05.573487 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1081/1331] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:08:05 2022] GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:06.585560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4c9e6e6c-e7b6-4391-abfc-fd524c98ef81 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f9efa700>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:06.614747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4c9e6e6c-e7b6-4391-abfc-fd524c98ef81 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 200 len: 286 microversion: 2.1 time: 0.034708 Jun 27 15:08:06.616045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1082/1332] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:08:06 2022] GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:07.627574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d2f6d2ce-c9cc-494a-b2d1-0a8876aa22e7 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13fe224af0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:07.656635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d2f6d2ce-c9cc-494a-b2d1-0a8876aa22e7 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 200 len: 286 microversion: 2.1 time: 0.033267 Jun 27 15:08:07.657542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1083/1333] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:08:07 2022] GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:08.669483 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f45865a4-de57-48d4-9326-27b3e8ef15db tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13fe2ec9d0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:08.725236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f45865a4-de57-48d4-9326-27b3e8ef15db tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 200 len: 286 microversion: 2.1 time: 0.053344 Jun 27 15:08:08.725236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1084/1334] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:08:08 2022] GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:09.735816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-62eb0f44-054e-4025-890b-0d0213175b58 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13fe31da60>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:09.771394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-62eb0f44-054e-4025-890b-0d0213175b58 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 200 len: 287 microversion: 2.1 time: 0.036443 Jun 27 15:08:09.771394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1085/1335] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:08:09 2022] GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:09.778365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ce4687b4-03f9-472c-b7ac-b1723409211d tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13fe2b79d0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:09.918686 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ce4687b4-03f9-472c-b7ac-b1723409211d tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 202 len: 0 microversion: 2.1 time: 0.140514 Jun 27 15:08:09.918686 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1086/1336] 10.222.0.44 () {58 vars in 1253 bytes} [Mon Jun 27 15:08:09 2022] DELETE /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:08:09.925143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-caa9f462-04da-4ff3-8c53-a6036f337f8e tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f96e1160>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:09.960558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-caa9f462-04da-4ff3-8c53-a6036f337f8e tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 200 len: 286 microversion: 2.1 time: 0.040569 Jun 27 15:08:09.961171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1087/1337] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:08:09 2022] GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:08:10.979344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ad4867ca-d2d4-4ece-9d93-011f4ffe958c tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13fe2b79d0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:11.003377 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-ad4867ca-d2d4-4ece-9d93-011f4ffe958c tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] HTTP exception thrown: Snapshot 198f242f-3114-4987-955e-d2a6887fce88 could not be found. Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ad4867ca-d2d4-4ece-9d93-011f4ffe958c tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Request method failure captured: Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 HTTP/1.1 Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfR2l6tZ3gNH32WOkhADV6vSDd-JqCTSOsmuz4T_iSoMBSSs-ig0WhyweVb62HwXGrQPPs7rgLEKNRMxwbopF2cEOBjvbXexqBIg7aKfFI00ZDrLYUxY64ZIbCXy-gUM0lxpF_AWpc_tFDKW1R5KjODNivVCrxZL8dE0cYJA0q8FEk Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6900e202b511498fa4f15f21e589127c Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:11.009011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6900e202b511498fa4f15f21e589127c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6900e202b511498fa4f15f21e589127c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6900e202b511498fa4f15f21e589127c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6900e202b511498fa4f15f21e589127c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6900e202b511498fa4f15f21e589127c Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesSnapshotsTestJSON-1418763603-project Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 115aeebf9834427993165751c9859fe6 Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1418763603-project Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Snapshot 198f242f-3114-4987-955e-d2a6887fce88 could not be found. Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '198f242f-3114-4987-955e-d2a6887fce88'} Jun 27 15:08:11.010774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 198f242f-3114-4987-955e-d2a6887fce88 could not be found. (HTTP 404) (Request-ID: req-cf6e9cb9-63ed-488f-bbb8-1cf97edf9aa3) Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:11.011773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:08:11.013314 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 198f242f-3114-4987-955e-d2a6887fce88 could not be found. Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 27 15:08:11.014962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 198f242f-3114-4987-955e-d2a6887fce88 could not be found. Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 198f242f-3114-4987-955e-d2a6887fce88 could not be found. Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ad4867ca-d2d4-4ece-9d93-011f4ffe958c tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Returning 404 to user: Snapshot 198f242f-3114-4987-955e-d2a6887fce88 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:11.017104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ad4867ca-d2d4-4ece-9d93-011f4ffe958c tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88" status: 404 len: 111 microversion: 2.1 time: 0.042903 Jun 27 15:08:11.018233 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1088/1338] 10.222.0.44 () {58 vars in 1250 bytes} [Mon Jun 27 15:08:10 2022] GET /compute/v2.1/os-snapshots/198f242f-3114-4987-955e-d2a6887fce88 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:08:11.019485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fa2e9091-4241-4e25-b1aa-4eeae9616ad1 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f960d670>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:11.258935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fa2e9091-4241-4e25-b1aa-4eeae9616ad1 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655" status: 202 len: 0 microversion: 2.1 time: 0.243193 Jun 27 15:08:11.259585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1089/1339] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:08:11 2022] DELETE /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:08:11.268564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d2b0ebdc-c797-45d0-aa8a-6797e6778716 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f9c5c790>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:11.324759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d2b0ebdc-c797-45d0-aa8a-6797e6778716 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655" status: 200 len: 344 microversion: 2.1 time: 0.060656 Jun 27 15:08:11.325552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1090/1340] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:11 2022] GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:12.338111 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e9ae456a-ce5d-427c-9707-e3fdc2bc96a1 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13fe2b7670>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:12.365711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-e9ae456a-ce5d-427c-9707-e3fdc2bc96a1 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] HTTP exception thrown: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e9ae456a-ce5d-427c-9707-e3fdc2bc96a1 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Request method failure captured: Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 HTTP/1.1 Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfR2l6tZ3gNH32WOkhADV6vSDd-JqCTSOsmuz4T_iSoMBSSs-ig0WhyweVb62HwXGrQPPs7rgLEKNRMxwbopF2cEOBjvbXexqBIg7aKfFI00ZDrLYUxY64ZIbCXy-gUM0lxpF_AWpc_tFDKW1R5KjODNivVCrxZL8dE0cYJA0q8FEk Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6900e202b511498fa4f15f21e589127c Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:12.367873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6900e202b511498fa4f15f21e589127c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6900e202b511498fa4f15f21e589127c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6900e202b511498fa4f15f21e589127c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6900e202b511498fa4f15f21e589127c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6900e202b511498fa4f15f21e589127c Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesSnapshotsTestJSON-1418763603-project Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 115aeebf9834427993165751c9859fe6 Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1418763603-project Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '9a856814-a1cb-4c21-9bbb-481f87c78655'} Jun 27 15:08:12.369536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. (HTTP 404) (Request-ID: req-14c7c6cc-50c5-4ddf-8c04-f31e5f0e5676) Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:12.370555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:08:12.372011 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:08:12.373457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.375166 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.378106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e9ae456a-ce5d-427c-9707-e3fdc2bc96a1 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Returning 404 to user: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:12.378106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e9ae456a-ce5d-427c-9707-e3fdc2bc96a1 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655" status: 404 len: 109 microversion: 2.1 time: 0.043916 Jun 27 15:08:12.378106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1091/1341] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:12 2022] GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:08:12.388895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a91e70e8-d1cc-4f11-8f6a-bac24f0754c6 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13f95769d0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:12.421438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-a91e70e8-d1cc-4f11-8f6a-bac24f0754c6 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] HTTP exception thrown: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a91e70e8-d1cc-4f11-8f6a-bac24f0754c6 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Request method failure captured: Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 HTTP/1.1 Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfR2l6tZ3gNH32WOkhADV6vSDd-JqCTSOsmuz4T_iSoMBSSs-ig0WhyweVb62HwXGrQPPs7rgLEKNRMxwbopF2cEOBjvbXexqBIg7aKfFI00ZDrLYUxY64ZIbCXy-gUM0lxpF_AWpc_tFDKW1R5KjODNivVCrxZL8dE0cYJA0q8FEk Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6900e202b511498fa4f15f21e589127c Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:12.423810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6900e202b511498fa4f15f21e589127c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6900e202b511498fa4f15f21e589127c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6900e202b511498fa4f15f21e589127c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6900e202b511498fa4f15f21e589127c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6900e202b511498fa4f15f21e589127c Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesSnapshotsTestJSON-1418763603-project Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 115aeebf9834427993165751c9859fe6 Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1418763603-project Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '9a856814-a1cb-4c21-9bbb-481f87c78655'} Jun 27 15:08:12.425305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. (HTTP 404) (Request-ID: req-d542dabf-aec3-4241-935d-3484d654be41) Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:12.426174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:08:12.427940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 15:08:12.429460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a91e70e8-d1cc-4f11-8f6a-bac24f0754c6 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Returning 404 to user: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:12.432188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a91e70e8-d1cc-4f11-8f6a-bac24f0754c6 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655" status: 404 len: 109 microversion: 2.1 time: 0.041074 Jun 27 15:08:12.434231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1092/1342] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:08:12 2022] DELETE /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:08:12.436053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-561968ae-97c4-4c55-abec-3483c5307f48 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Calling method '.version_select at 0x7f13fe2b70d0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:12.466626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-561968ae-97c4-4c55-abec-3483c5307f48 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] HTTP exception thrown: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-561968ae-97c4-4c55-abec-3483c5307f48 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Request method failure captured: Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 HTTP/1.1 Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfR2l6tZ3gNH32WOkhADV6vSDd-JqCTSOsmuz4T_iSoMBSSs-ig0WhyweVb62HwXGrQPPs7rgLEKNRMxwbopF2cEOBjvbXexqBIg7aKfFI00ZDrLYUxY64ZIbCXy-gUM0lxpF_AWpc_tFDKW1R5KjODNivVCrxZL8dE0cYJA0q8FEk Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 6900e202b511498fa4f15f21e589127c Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:12.468756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6900e202b511498fa4f15f21e589127c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6900e202b511498fa4f15f21e589127c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6900e202b511498fa4f15f21e589127c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6900e202b511498fa4f15f21e589127c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 6900e202b511498fa4f15f21e589127c Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1418763603 Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesSnapshotsTestJSON-1418763603-project Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 115aeebf9834427993165751c9859fe6 Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1418763603-project Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '9a856814-a1cb-4c21-9bbb-481f87c78655'} Jun 27 15:08:12.470188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. (HTTP 404) (Request-ID: req-8754f67c-88d9-4680-b22f-094c6d6ef4fd) Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:12.471015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:08:12.472219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:08:12.475409 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-561968ae-97c4-4c55-abec-3483c5307f48 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] Returning 404 to user: Volume 9a856814-a1cb-4c21-9bbb-481f87c78655 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-561968ae-97c4-4c55-abec-3483c5307f48 tempest-VolumesSnapshotsTestJSON-1418763603 tempest-VolumesSnapshotsTestJSON-1418763603-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655" status: 404 len: 109 microversion: 2.1 time: 0.038932 Jun 27 15:08:12.478107 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1093/1343] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:12 2022] GET /compute/v2.1/os-volumes/9a856814-a1cb-4c21-9bbb-481f87c78655 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:08:13.977207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:13.977967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:14.116830 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e5140260-d9a5-48e8-a85a-7711e6a51b42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'create', calling method: .version_select at 0x7f13f95dca60>, body: {"keypair": {"name": "tempest-keypair-1309445081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTQIYa14C+JsmfnxmxFXR/fuGj6n+8OklyViK090jeX5FwU4/pzAQv1bHiZjKoWpMgbKxl9cg1q5akTPQrrzPaqZK5xDq8GdX7NaLti0ZTlhHtv5bmo1nw7c2PXgMGVIg=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:14.134755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-e5140260-d9a5-48e8-a85a-7711e6a51b42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Getting quotas for project fa77b298448a40bbb2f12e1b5b9c5967. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:08:14.140458 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-e5140260-d9a5-48e8-a85a-7711e6a51b42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Getting quotas for user 093402db51104953a681418b958b2c38 and project fa77b298448a40bbb2f12e1b5b9c5967. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:08:14.218072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e5140260-d9a5-48e8-a85a-7711e6a51b42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.241641 Jun 27 15:08:14.224763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1094/1344] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 15:08:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:14.966075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-09c2f70b-1861-4701-83e4-5e766b11a2ae tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] Action: 'create', calling method: .version_select at 0x7f13f960d5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1925915496", "metadata": {"Type": "work"}}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:15.625761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-09c2f70b-1861-4701-83e4-5e766b11a2ae tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.787539 Jun 27 15:08:15.626646 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1095/1345] 10.222.0.44 () {60 vars in 1155 bytes} [Mon Jun 27 15:08:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 789 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 27 15:08:15.638460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-044e389a-31b8-41bd-b60f-3119bce0de74 tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] Calling method '.version_select at 0x7f13fe2c78b0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:15.694157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-044e389a-31b8-41bd-b60f-3119bce0de74 tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef" status: 200 len: 353 microversion: 2.1 time: 0.059347 Jun 27 15:08:15.695901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1096/1346] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:15 2022] GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:08:16.537087 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1018696539", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33d44254-c39d-4ab7-9385-1f3e9a2d0259"}], "security_groups": [{"name": "tempest-securitygroup--261023660"}], "key_name": "tempest-keypair-1309445081", "user_data": "}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:16.670152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] validate_networks() for [('33d44254-c39d-4ab7-9385-1f3e9a2d0259', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:08:17.199920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:08:17.200539 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:08:17.201205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:08:17.201772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:08:17.202448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:08:17.213712 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:17.214460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:17.215942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:17.216722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:17.237489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Getting quotas for project fa77b298448a40bbb2f12e1b5b9c5967. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:08:17.242410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Getting quotas for user 093402db51104953a681418b958b2c38 and project fa77b298448a40bbb2f12e1b5b9c5967. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:08:17.254108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:08:17.257097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:08:17.373317 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d7795f4a-1b87-4e6a-a0a3-7f6ee8f58604 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.848484 Jun 27 15:08:17.374475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1097/1347] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:08:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:08:17.385024 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6d3ad8f5-5aaf-4ef7-9656-f51a06c43bdb tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] Calling method '.version_select at 0x7f13fe2290d0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:17.441885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6d3ad8f5-5aaf-4ef7-9656-f51a06c43bdb tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef" status: 200 len: 354 microversion: 2.1 time: 0.066212 Jun 27 15:08:17.442463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1098/1348] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:17 2022] GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:08:17.448534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2ad5d102-2cf7-4629-817f-e647518f840e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:17.448534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2ad5d102-2cf7-4629-817f-e647518f840e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:17.504373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2ad5d102-2cf7-4629-817f-e647518f840e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:17.511494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2ad5d102-2cf7-4629-817f-e647518f840e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1238 microversion: 2.1 time: 0.067666 Jun 27 15:08:17.512061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1099/1349] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:17 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:08:17.520218 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-025f56b6-7f27-4b5f-a2d5-03b5e9de16ee tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] Calling method '.version_select at 0x7f13f95dca60>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:17.577280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-025f56b6-7f27-4b5f-a2d5-03b5e9de16ee tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef" status: 200 len: 354 microversion: 2.1 time: 0.064155 Jun 27 15:08:17.577860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1100/1350] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:17 2022] GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:08:17.594196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-942ebca8-4470-48cc-93e2-4d428a058bad tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] Calling method '.version_select at 0x7f13fe15cee0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:17.782131 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-942ebca8-4470-48cc-93e2-4d428a058bad tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef" status: 202 len: 0 microversion: 2.1 time: 0.191708 Jun 27 15:08:17.784784 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1101/1351] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:08:17 2022] DELETE /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:08:17.790451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b06cb491-531c-4e1a-9bd7-9104786f9d2b tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] Calling method '.version_select at 0x7f13f9c5cca0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:17.841080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b06cb491-531c-4e1a-9bd7-9104786f9d2b tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef" status: 200 len: 353 microversion: 2.1 time: 0.054168 Jun 27 15:08:17.841683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1102/1352] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:17 2022] GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:18.529868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6de53adf-23d6-415e-ac2f-a4552dc66cf4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:18.556415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6de53adf-23d6-415e-ac2f-a4552dc66cf4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:18.585683 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6de53adf-23d6-415e-ac2f-a4552dc66cf4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:18.592434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6de53adf-23d6-415e-ac2f-a4552dc66cf4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1238 microversion: 2.1 time: 0.066960 Jun 27 15:08:18.593045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1103/1353] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:18 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:18.852944 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e096a5e6-674e-4044-988b-062ab8394e8f tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] Calling method '.version_select at 0x7f13fe24ad30>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:18.882960 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-e096a5e6-674e-4044-988b-062ab8394e8f tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] HTTP exception thrown: Volume 71b33347-a36e-48d3-8d30-32cf9a2b8bef could not be found. Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e096a5e6-674e-4044-988b-062ab8394e8f tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] Request method failure captured: Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef HTTP/1.1 Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfeDkIXiSEC24RiyvIGXLGrUVUydUweDPcUxpSozGhDKunrDl983WVce3vZv8ToEO0F-jCIUyqk2RYKl6xFkujDgqwUQh6huCCmIqiM0-8goYjRDC9zaazi3_zHmUTRAVCQcLYqzqLxRyjwX3bduhuc6XL-K3elCgqqGUr98VDzf7I Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 96a480b54ff64ea0a90762bec32c3a0f Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-VolumesGetTestJSON-223721040 Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:18.884796 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_96a480b54ff64ea0a90762bec32c3a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a480b54ff64ea0a90762bec32c3a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/96a480b54ff64ea0a90762bec32c3a0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96a480b54ff64ea0a90762bec32c3a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-VolumesGetTestJSON-223721040 Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 96a480b54ff64ea0a90762bec32c3a0f Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-VolumesGetTestJSON-223721040 Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-VolumesGetTestJSON-223721040-project Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 0213f9d061e44262942b3e9fff7d4fc6 Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-VolumesGetTestJSON-223721040-project Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Volume 71b33347-a36e-48d3-8d30-32cf9a2b8bef could not be found. Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '71b33347-a36e-48d3-8d30-32cf9a2b8bef'} Jun 27 15:08:18.886493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71b33347-a36e-48d3-8d30-32cf9a2b8bef could not be found. (HTTP 404) (Request-ID: req-dc8b006e-4b68-49e0-90f5-6e00b335ffc5) Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:18.887439 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:08:18.888751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71b33347-a36e-48d3-8d30-32cf9a2b8bef could not be found. Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:08:18.889966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71b33347-a36e-48d3-8d30-32cf9a2b8bef could not be found. Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71b33347-a36e-48d3-8d30-32cf9a2b8bef could not be found. Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e096a5e6-674e-4044-988b-062ab8394e8f tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] Returning 404 to user: Volume 71b33347-a36e-48d3-8d30-32cf9a2b8bef could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e096a5e6-674e-4044-988b-062ab8394e8f tempest-VolumesGetTestJSON-223721040 tempest-VolumesGetTestJSON-223721040-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef" status: 404 len: 109 microversion: 2.1 time: 0.037329 Jun 27 15:08:18.891207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1104/1354] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:08:18 2022] GET /compute/v2.1/os-volumes/71b33347-a36e-48d3-8d30-32cf9a2b8bef => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:08:19.610818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-028f2073-d6ac-4f73-bec6-54e276552424 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:19.611350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-028f2073-d6ac-4f73-bec6-54e276552424 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:19.617714 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-028f2073-d6ac-4f73-bec6-54e276552424 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:19.618249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-028f2073-d6ac-4f73-bec6-54e276552424 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:19.619076 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-028f2073-d6ac-4f73-bec6-54e276552424 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:19.619571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-028f2073-d6ac-4f73-bec6-54e276552424 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:19.692969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-028f2073-d6ac-4f73-bec6-54e276552424 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:19.704751 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-028f2073-d6ac-4f73-bec6-54e276552424 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1290 microversion: 2.1 time: 0.098129 Jun 27 15:08:19.705333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1105/1355] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:19 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:20.725723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-98585c71-d1e8-40d8-a6bc-9fc41e2da05e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:20.726434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-98585c71-d1e8-40d8-a6bc-9fc41e2da05e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:20.734143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-98585c71-d1e8-40d8-a6bc-9fc41e2da05e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:20.734680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-98585c71-d1e8-40d8-a6bc-9fc41e2da05e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:20.735437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-98585c71-d1e8-40d8-a6bc-9fc41e2da05e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:20.736165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-98585c71-d1e8-40d8-a6bc-9fc41e2da05e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:20.891851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-98585c71-d1e8-40d8-a6bc-9fc41e2da05e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:20.901496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-98585c71-d1e8-40d8-a6bc-9fc41e2da05e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1363 microversion: 2.1 time: 0.182515 Jun 27 15:08:20.912023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1106/1356] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:20 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:08:21.730244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-01b6d298-27ba-4e5e-8939-a908529bfaab req-ad05c5a8-c4bc-4ba4-8a9d-5754e197c27b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9fd2bf-be40-498e-94d5-8ea8e588bcba", "tag": "dda4dc60-e343-47ed-97db-a6e302c3885c"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:21.742271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-01b6d298-27ba-4e5e-8939-a908529bfaab req-ad05c5a8-c4bc-4ba4-8a9d-5754e197c27b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:21.742789 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-01b6d298-27ba-4e5e-8939-a908529bfaab req-ad05c5a8-c4bc-4ba4-8a9d-5754e197c27b service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:21.758568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-01b6d298-27ba-4e5e-8939-a908529bfaab req-ad05c5a8-c4bc-4ba4-8a9d-5754e197c27b service nova] Creating event network-changed:dda4dc60-e343-47ed-97db-a6e302c3885c for instance da9fd2bf-be40-498e-94d5-8ea8e588bcba on hv-cinder-79760 Jun 27 15:08:21.766330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-01b6d298-27ba-4e5e-8939-a908529bfaab req-ad05c5a8-c4bc-4ba4-8a9d-5754e197c27b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040016 Jun 27 15:08:21.767021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1107/1357] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:21.920114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4d9add30-f22e-497c-8c4b-7032d11a4657 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:21.920868 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4d9add30-f22e-497c-8c4b-7032d11a4657 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:21.928392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d9add30-f22e-497c-8c4b-7032d11a4657 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:21.934426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d9add30-f22e-497c-8c4b-7032d11a4657 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:21.934426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d9add30-f22e-497c-8c4b-7032d11a4657 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:21.934426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d9add30-f22e-497c-8c4b-7032d11a4657 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:22.129514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4d9add30-f22e-497c-8c4b-7032d11a4657 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:22.137772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4d9add30-f22e-497c-8c4b-7032d11a4657 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1363 microversion: 2.1 time: 0.222178 Jun 27 15:08:22.138342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1108/1358] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:21 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:23.154263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-53d4929f-5746-4504-a8e9-299d413bb744 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:23.154886 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-53d4929f-5746-4504-a8e9-299d413bb744 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:23.161895 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-53d4929f-5746-4504-a8e9-299d413bb744 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:23.162326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-53d4929f-5746-4504-a8e9-299d413bb744 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:23.163079 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-53d4929f-5746-4504-a8e9-299d413bb744 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:23.163511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-53d4929f-5746-4504-a8e9-299d413bb744 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:23.330730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-53d4929f-5746-4504-a8e9-299d413bb744 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:23.338856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-53d4929f-5746-4504-a8e9-299d413bb744 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1363 microversion: 2.1 time: 0.188457 Jun 27 15:08:23.339427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1109/1359] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:23 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:24.355906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b5ed9898-5436-453e-8406-cfd030c436e4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:24.356558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b5ed9898-5436-453e-8406-cfd030c436e4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:24.363013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b5ed9898-5436-453e-8406-cfd030c436e4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:24.363534 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b5ed9898-5436-453e-8406-cfd030c436e4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:24.364602 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b5ed9898-5436-453e-8406-cfd030c436e4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:24.365265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b5ed9898-5436-453e-8406-cfd030c436e4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:24.498474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b5ed9898-5436-453e-8406-cfd030c436e4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:24.506745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b5ed9898-5436-453e-8406-cfd030c436e4 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1363 microversion: 2.1 time: 0.154643 Jun 27 15:08:24.507484 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1110/1360] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:24 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:25.523775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-96283e34-454d-4d8e-b80a-80c323f2508d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:25.524455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-96283e34-454d-4d8e-b80a-80c323f2508d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:25.530814 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96283e34-454d-4d8e-b80a-80c323f2508d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:25.531276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96283e34-454d-4d8e-b80a-80c323f2508d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:25.532017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96283e34-454d-4d8e-b80a-80c323f2508d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:25.532442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96283e34-454d-4d8e-b80a-80c323f2508d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:25.658913 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-96283e34-454d-4d8e-b80a-80c323f2508d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:25.667170 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-96283e34-454d-4d8e-b80a-80c323f2508d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1363 microversion: 2.1 time: 0.147403 Jun 27 15:08:25.667724 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1111/1361] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:25 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:26.684525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-32309cfa-e326-4f38-b425-66d7f4fa8aef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:26.685192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-32309cfa-e326-4f38-b425-66d7f4fa8aef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:26.691519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32309cfa-e326-4f38-b425-66d7f4fa8aef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:26.691953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32309cfa-e326-4f38-b425-66d7f4fa8aef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:26.692733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32309cfa-e326-4f38-b425-66d7f4fa8aef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:26.693214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32309cfa-e326-4f38-b425-66d7f4fa8aef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:26.831643 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-32309cfa-e326-4f38-b425-66d7f4fa8aef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:26.839394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-32309cfa-e326-4f38-b425-66d7f4fa8aef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1363 microversion: 2.1 time: 0.158758 Jun 27 15:08:26.839949 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1112/1362] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:26 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:27.855795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-08b1448c-8ad5-47c6-908b-f78818fbcd85 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:27.856416 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-08b1448c-8ad5-47c6-908b-f78818fbcd85 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:27.858305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:27.863535 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08b1448c-8ad5-47c6-908b-f78818fbcd85 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:27.863975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08b1448c-8ad5-47c6-908b-f78818fbcd85 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:27.864740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08b1448c-8ad5-47c6-908b-f78818fbcd85 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:27.865773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08b1448c-8ad5-47c6-908b-f78818fbcd85 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:28.001655 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-08b1448c-8ad5-47c6-908b-f78818fbcd85 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:28.010767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-08b1448c-8ad5-47c6-908b-f78818fbcd85 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1363 microversion: 2.1 time: 0.157954 Jun 27 15:08:28.010767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1113/1363] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:27 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:28.641441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=14 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:28.763736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-49042220-47fc-4e71-a007-b9188dae0a6f req-8df67167-ac63-4a1d-838f-9fbf95664887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9fd2bf-be40-498e-94d5-8ea8e588bcba", "name": "network-vif-plugged", "status": "completed", "tag": "dda4dc60-e343-47ed-97db-a6e302c3885c"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:28.772266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-49042220-47fc-4e71-a007-b9188dae0a6f req-8df67167-ac63-4a1d-838f-9fbf95664887 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:28.772741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-49042220-47fc-4e71-a007-b9188dae0a6f req-8df67167-ac63-4a1d-838f-9fbf95664887 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:28.784613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-49042220-47fc-4e71-a007-b9188dae0a6f req-8df67167-ac63-4a1d-838f-9fbf95664887 service nova] Creating event network-vif-plugged:dda4dc60-e343-47ed-97db-a6e302c3885c for instance da9fd2bf-be40-498e-94d5-8ea8e588bcba on hv-cinder-79760 Jun 27 15:08:28.789500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-49042220-47fc-4e71-a007-b9188dae0a6f req-8df67167-ac63-4a1d-838f-9fbf95664887 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152441 Jun 27 15:08:28.790073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1114/1364] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:29.027844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-72f18b39-808b-4b82-b701-b0db46c7f489 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:29.028671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-72f18b39-808b-4b82-b701-b0db46c7f489 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:29.035401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-72f18b39-808b-4b82-b701-b0db46c7f489 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:29.035851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-72f18b39-808b-4b82-b701-b0db46c7f489 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:29.036612 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-72f18b39-808b-4b82-b701-b0db46c7f489 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:29.037636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-72f18b39-808b-4b82-b701-b0db46c7f489 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:29.178680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-72f18b39-808b-4b82-b701-b0db46c7f489 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:29.186286 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-72f18b39-808b-4b82-b701-b0db46c7f489 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1363 microversion: 2.1 time: 0.163154 Jun 27 15:08:29.190017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1115/1365] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:29 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:30.205554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-54d205d1-7df3-4599-a924-96302be97cdc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:30.206211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-54d205d1-7df3-4599-a924-96302be97cdc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:30.212894 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54d205d1-7df3-4599-a924-96302be97cdc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:30.213339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54d205d1-7df3-4599-a924-96302be97cdc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:30.214089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54d205d1-7df3-4599-a924-96302be97cdc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:30.214517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-54d205d1-7df3-4599-a924-96302be97cdc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:30.341381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-54d205d1-7df3-4599-a924-96302be97cdc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:30.348966 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-54d205d1-7df3-4599-a924-96302be97cdc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1363 microversion: 2.1 time: 0.147294 Jun 27 15:08:30.349524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1116/1366] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:30 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:31.365777 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ac46658f-6b64-4771-b2ea-6f4a7dff95fd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:31.366419 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ac46658f-6b64-4771-b2ea-6f4a7dff95fd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:31.373343 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac46658f-6b64-4771-b2ea-6f4a7dff95fd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:31.373790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac46658f-6b64-4771-b2ea-6f4a7dff95fd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:31.374531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac46658f-6b64-4771-b2ea-6f4a7dff95fd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:31.374959 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ac46658f-6b64-4771-b2ea-6f4a7dff95fd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:31.501453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ac46658f-6b64-4771-b2ea-6f4a7dff95fd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:31.508781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ac46658f-6b64-4771-b2ea-6f4a7dff95fd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1548 microversion: 2.1 time: 0.146890 Jun 27 15:08:31.509406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1117/1367] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:31 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:31.525462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-eb636e4c-1d87-4625-b227-99c5829d77cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:31.525968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-eb636e4c-1d87-4625-b227-99c5829d77cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:31.531562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb636e4c-1d87-4625-b227-99c5829d77cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:31.532035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb636e4c-1d87-4625-b227-99c5829d77cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:31.532839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb636e4c-1d87-4625-b227-99c5829d77cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:31.533270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb636e4c-1d87-4625-b227-99c5829d77cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:31.612130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-eb636e4c-1d87-4625-b227-99c5829d77cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091084 Jun 27 15:08:31.612752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1118/1368] 10.222.0.44 () {58 vars in 1274 bytes} [Mon Jun 27 15:08:31 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:32.934498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-f791c353-fad9-4809-8f8b-f074c6c88df6 req-55f93acf-7f1e-4451-a256-2218d1dbef7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9fd2bf-be40-498e-94d5-8ea8e588bcba", "tag": "dda4dc60-e343-47ed-97db-a6e302c3885c"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:32.942855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f791c353-fad9-4809-8f8b-f074c6c88df6 req-55f93acf-7f1e-4451-a256-2218d1dbef7c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:32.943297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f791c353-fad9-4809-8f8b-f074c6c88df6 req-55f93acf-7f1e-4451-a256-2218d1dbef7c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:32.955366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-f791c353-fad9-4809-8f8b-f074c6c88df6 req-55f93acf-7f1e-4451-a256-2218d1dbef7c service nova] Creating event network-changed:dda4dc60-e343-47ed-97db-a6e302c3885c for instance da9fd2bf-be40-498e-94d5-8ea8e588bcba on hv-cinder-79760 Jun 27 15:08:32.960447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-f791c353-fad9-4809-8f8b-f074c6c88df6 req-55f93acf-7f1e-4451-a256-2218d1dbef7c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087961 Jun 27 15:08:32.961847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1119/1369] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:08:51.177590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:51.178585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=78 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:51.182613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-842a9793-9c3a-424d-89d8-542db637503a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:51.183185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-842a9793-9c3a-424d-89d8-542db637503a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:51.189350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-842a9793-9c3a-424d-89d8-542db637503a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:51.190327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-842a9793-9c3a-424d-89d8-542db637503a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:51.190606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-842a9793-9c3a-424d-89d8-542db637503a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:51.191039 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-842a9793-9c3a-424d-89d8-542db637503a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:51.217662 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-842a9793-9c3a-424d-89d8-542db637503a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:08:51.478731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-842a9793-9c3a-424d-89d8-542db637503a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 204 len: 0 microversion: 2.1 time: 0.302629 Jun 27 15:08:51.479367 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1120/1370] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:08:51 2022] DELETE /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:08:51.487548 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1771e5db-ff8b-4c2c-8fad-9b8c81fb8c42 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:51.488229 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1771e5db-ff8b-4c2c-8fad-9b8c81fb8c42 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:51.494124 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1771e5db-ff8b-4c2c-8fad-9b8c81fb8c42 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:51.494557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1771e5db-ff8b-4c2c-8fad-9b8c81fb8c42 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:51.495296 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1771e5db-ff8b-4c2c-8fad-9b8c81fb8c42 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:51.495717 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1771e5db-ff8b-4c2c-8fad-9b8c81fb8c42 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:51.632493 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1771e5db-ff8b-4c2c-8fad-9b8c81fb8c42 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:51.640857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1771e5db-ff8b-4c2c-8fad-9b8c81fb8c42 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1578 microversion: 2.1 time: 0.157238 Jun 27 15:08:51.641427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1121/1371] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:51 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:52.658950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-99a1fb85-6091-4c45-82d8-4dc8dbb1a108 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:52.659768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-99a1fb85-6091-4c45-82d8-4dc8dbb1a108 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:52.665865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99a1fb85-6091-4c45-82d8-4dc8dbb1a108 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:52.666313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99a1fb85-6091-4c45-82d8-4dc8dbb1a108 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:52.667772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99a1fb85-6091-4c45-82d8-4dc8dbb1a108 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:52.667772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-99a1fb85-6091-4c45-82d8-4dc8dbb1a108 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:52.828235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-99a1fb85-6091-4c45-82d8-4dc8dbb1a108 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:52.838794 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-99a1fb85-6091-4c45-82d8-4dc8dbb1a108 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1578 microversion: 2.1 time: 0.183031 Jun 27 15:08:52.840042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1122/1372] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:52 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:53.863110 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b66b7a32-eab3-49e8-ad01-12fbc6d9c179 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:53.863804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b66b7a32-eab3-49e8-ad01-12fbc6d9c179 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:53.870179 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b66b7a32-eab3-49e8-ad01-12fbc6d9c179 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:53.873969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b66b7a32-eab3-49e8-ad01-12fbc6d9c179 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:53.873969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b66b7a32-eab3-49e8-ad01-12fbc6d9c179 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:53.873969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b66b7a32-eab3-49e8-ad01-12fbc6d9c179 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:54.096496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b66b7a32-eab3-49e8-ad01-12fbc6d9c179 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:54.105040 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b66b7a32-eab3-49e8-ad01-12fbc6d9c179 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1578 microversion: 2.1 time: 0.245680 Jun 27 15:08:54.106511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1123/1373] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:53 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:54.869547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-a83f8e33-5296-4c01-97fe-a49ad42af137 req-a4c7c1c1-f568-4ae9-9fd7-80a79e29bfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4300d49-751c-4048-bde6-5d4a1d940515", "name": "network-vif-deleted", "tag": "6780a0e6-aa6c-4742-b45f-385a5bbf0b86"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:54.881398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-a83f8e33-5296-4c01-97fe-a49ad42af137 req-a4c7c1c1-f568-4ae9-9fd7-80a79e29bfcc service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:54.881837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-a83f8e33-5296-4c01-97fe-a49ad42af137 req-a4c7c1c1-f568-4ae9-9fd7-80a79e29bfcc service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:54.894246 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-a83f8e33-5296-4c01-97fe-a49ad42af137 req-a4c7c1c1-f568-4ae9-9fd7-80a79e29bfcc service nova] Creating event network-vif-deleted:6780a0e6-aa6c-4742-b45f-385a5bbf0b86 for instance a4300d49-751c-4048-bde6-5d4a1d940515 on hv-cinder-79760 Jun 27 15:08:54.899235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-a83f8e33-5296-4c01-97fe-a49ad42af137 req-a4c7c1c1-f568-4ae9-9fd7-80a79e29bfcc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034588 Jun 27 15:08:54.900023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1124/1374] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:08:55.124394 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-79eeff2b-fed0-49d8-84f7-7ccf13bd63c4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:55.127158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-79eeff2b-fed0-49d8-84f7-7ccf13bd63c4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:55.131596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79eeff2b-fed0-49d8-84f7-7ccf13bd63c4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:55.132048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79eeff2b-fed0-49d8-84f7-7ccf13bd63c4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:55.132910 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79eeff2b-fed0-49d8-84f7-7ccf13bd63c4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:55.133415 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79eeff2b-fed0-49d8-84f7-7ccf13bd63c4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:55.199806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-79eeff2b-fed0-49d8-84f7-7ccf13bd63c4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:55.208114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-79eeff2b-fed0-49d8-84f7-7ccf13bd63c4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1226 microversion: 2.1 time: 0.088874 Jun 27 15:08:55.208705 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1125/1375] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:55 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:08:56.226059 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:56.227666 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:56.235347 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:56.235901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:56.236759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:56.237254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:56.271628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:56.272075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:56.272515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lazy-loading 'fault' on Instance uuid a4300d49-751c-4048-bde6-5d4a1d940515 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:08:56.317940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:56.324885 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-eb84a25c-fa7a-4f9d-97ef-9522fb53bbc5 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 200 len: 1185 microversion: 2.1 time: 0.103318 Jun 27 15:08:56.325461 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1126/1376] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:56 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 1185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:57.342531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:57.343222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:57.349523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:57.349968 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:57.350749 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:57.351181 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:57.366207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] HTTP exception thrown: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Request method failure captured: Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 HTTP/1.1 Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiuccxYZZsDfqlqbCH7qt_1Yv0161267ZZS4sQ1Mh-8yrm-FEOQAV6rf4MXiMAX6szq7di_fCk69J_C0tjWzqVvSEFIyQnZ3zqH2Hz7RrBfQKbvyzwGHhX5yRX3qI7UqHvEIwGq9biNtCZD3cvoRQa5GBLLmG2ONU74O31hb2xMTjr4-I Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:08:57.370045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-TestVolumeBootPattern-738308969 Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: e6357e83df904ea09221cfc374d776c4 Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:08:57.371877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'a4300d49-751c-4048-bde6-5d4a1d940515'} Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:08:57.373435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:08:57.375072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:08:57.376574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Returning 404 to user: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:08:57.376574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d34d6ac5-954d-4d6a-a320-8ef521013606 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 404 len: 111 microversion: 2.1 time: 0.030614 Jun 27 15:08:57.376574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1127/1377] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:57 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:08:57.463620 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1119763370", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1387064064", "security_groups": [{"name": "tempest-secgroup-smoke-2040048435"}], "block_device_mapping_v2": [{"uuid": "39dfc8b6-d428-4b4a-b0d3-f344aa58b009", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "102de29a-dcd6-421f-8631-f35b90da1246"}]}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:08:57.573672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] validate_networks() for [('102de29a-dcd6-421f-8631-f35b90da1246', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:08:57.941423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:08:57.942279 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:08:57.942393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:08:57.942759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:08:57.943164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:08:57.956447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:57.957211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:57.958017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:57.958450 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:57.976118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Getting quotas for project 2bba2dfe000d427b9ab9dff2601436f1. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:08:57.980074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Getting quotas for user e6357e83df904ea09221cfc374d776c4 and project 2bba2dfe000d427b9ab9dff2601436f1. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:08:58.037443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:08:58.039512 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39dfc8b6-d428-4b4a-b0d3-f344aa58b009',volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:08:58.456757 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-657f4f01-2583-4172-bae6-d41acc72fd70 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.996920 Jun 27 15:08:58.457616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1128/1378] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:08:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:08:58.467652 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1b787258-7c5e-43d1-a386-5a1c2821617d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:58.468505 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1b787258-7c5e-43d1-a386-5a1c2821617d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:58.522051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1b787258-7c5e-43d1-a386-5a1c2821617d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:58.529986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1b787258-7c5e-43d1-a386-5a1c2821617d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1095 microversion: 2.1 time: 0.065937 Jun 27 15:08:58.530561 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1129/1379] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:58 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:08:59.552148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-93127459-0ae7-4929-b572-5665c86a6bd8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:08:59.552881 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-93127459-0ae7-4929-b572-5665c86a6bd8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:08:59.559603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93127459-0ae7-4929-b572-5665c86a6bd8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:59.560599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93127459-0ae7-4929-b572-5665c86a6bd8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:59.561546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93127459-0ae7-4929-b572-5665c86a6bd8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:08:59.561975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-93127459-0ae7-4929-b572-5665c86a6bd8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:08:59.621829 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-93127459-0ae7-4929-b572-5665c86a6bd8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:08:59.629922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-93127459-0ae7-4929-b572-5665c86a6bd8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1137 microversion: 2.1 time: 0.081745 Jun 27 15:08:59.630500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1130/1380] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:08:59 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:00.647270 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-46bfbf6a-18b2-4a8d-a3d1-cf28b5131923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:00.647980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-46bfbf6a-18b2-4a8d-a3d1-cf28b5131923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:00.654694 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46bfbf6a-18b2-4a8d-a3d1-cf28b5131923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:00.655304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46bfbf6a-18b2-4a8d-a3d1-cf28b5131923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:00.656413 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46bfbf6a-18b2-4a8d-a3d1-cf28b5131923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:00.656938 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46bfbf6a-18b2-4a8d-a3d1-cf28b5131923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:00.729061 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-46bfbf6a-18b2-4a8d-a3d1-cf28b5131923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:00.737118 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-46bfbf6a-18b2-4a8d-a3d1-cf28b5131923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1211 microversion: 2.1 time: 0.093678 Jun 27 15:09:00.737684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1131/1381] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:00 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:01.754304 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7b2bb60f-a556-4c61-9524-ccbb043aa7bb tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:01.755136 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7b2bb60f-a556-4c61-9524-ccbb043aa7bb tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:01.762754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b2bb60f-a556-4c61-9524-ccbb043aa7bb tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:01.764047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b2bb60f-a556-4c61-9524-ccbb043aa7bb tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:01.765220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b2bb60f-a556-4c61-9524-ccbb043aa7bb tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:01.765660 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7b2bb60f-a556-4c61-9524-ccbb043aa7bb tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:02.162016 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7b2bb60f-a556-4c61-9524-ccbb043aa7bb tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:02.169509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7b2bb60f-a556-4c61-9524-ccbb043aa7bb tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1279 microversion: 2.1 time: 0.419196 Jun 27 15:09:02.170829 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1132/1382] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:01 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1279 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:02.259874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-f05d0540-2dd3-49f2-864d-dd35bc20897a req-58afbd2f-2391-45f6-a97a-a0c466500e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95dd20a9-56f2-45e8-918f-4be55af8daf5", "tag": "a9a30dca-ba32-42bd-87ab-d507a0394de8"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:09:02.269098 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f05d0540-2dd3-49f2-864d-dd35bc20897a req-58afbd2f-2391-45f6-a97a-a0c466500e83 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:02.269610 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f05d0540-2dd3-49f2-864d-dd35bc20897a req-58afbd2f-2391-45f6-a97a-a0c466500e83 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:02.282273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-f05d0540-2dd3-49f2-864d-dd35bc20897a req-58afbd2f-2391-45f6-a97a-a0c466500e83 service nova] Creating event network-changed:a9a30dca-ba32-42bd-87ab-d507a0394de8 for instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 on hv-cinder-79760 Jun 27 15:09:02.288833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-f05d0540-2dd3-49f2-864d-dd35bc20897a req-58afbd2f-2391-45f6-a97a-a0c466500e83 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032112 Jun 27 15:09:02.289643 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1133/1383] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:09:03.188122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-66ced732-4290-4293-931c-aae251cd0ccd tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:03.189496 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-66ced732-4290-4293-931c-aae251cd0ccd tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:03.195530 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-66ced732-4290-4293-931c-aae251cd0ccd tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:03.195973 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-66ced732-4290-4293-931c-aae251cd0ccd tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:03.196754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-66ced732-4290-4293-931c-aae251cd0ccd tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:03.197191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-66ced732-4290-4293-931c-aae251cd0ccd tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:03.329839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-66ced732-4290-4293-931c-aae251cd0ccd tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:03.337204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-66ced732-4290-4293-931c-aae251cd0ccd tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.153879 Jun 27 15:09:03.337762 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1134/1384] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:03 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:04.354080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-936a57ed-3880-4f86-b4d7-22d23d5a66e9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:04.354713 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-936a57ed-3880-4f86-b4d7-22d23d5a66e9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:04.361328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-936a57ed-3880-4f86-b4d7-22d23d5a66e9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:04.361765 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-936a57ed-3880-4f86-b4d7-22d23d5a66e9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:04.362508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-936a57ed-3880-4f86-b4d7-22d23d5a66e9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:04.362937 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-936a57ed-3880-4f86-b4d7-22d23d5a66e9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:04.492423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-936a57ed-3880-4f86-b4d7-22d23d5a66e9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:04.499774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-936a57ed-3880-4f86-b4d7-22d23d5a66e9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.149597 Jun 27 15:09:04.500327 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1135/1385] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:04 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:05.516184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8d1691f1-be9e-4573-9224-8227021e96fc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:05.516866 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8d1691f1-be9e-4573-9224-8227021e96fc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:05.523263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d1691f1-be9e-4573-9224-8227021e96fc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:05.523701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d1691f1-be9e-4573-9224-8227021e96fc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:05.524440 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d1691f1-be9e-4573-9224-8227021e96fc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:05.524887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d1691f1-be9e-4573-9224-8227021e96fc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:05.657719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8d1691f1-be9e-4573-9224-8227021e96fc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:05.665091 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8d1691f1-be9e-4573-9224-8227021e96fc tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.152681 Jun 27 15:09:05.665648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1136/1386] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:05 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:06.682067 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-820af56b-4f16-4cdd-b120-4d202a229bd4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:06.682754 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-820af56b-4f16-4cdd-b120-4d202a229bd4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:06.689128 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-820af56b-4f16-4cdd-b120-4d202a229bd4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:06.689557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-820af56b-4f16-4cdd-b120-4d202a229bd4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:06.690297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-820af56b-4f16-4cdd-b120-4d202a229bd4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:06.690720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-820af56b-4f16-4cdd-b120-4d202a229bd4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:06.819378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-820af56b-4f16-4cdd-b120-4d202a229bd4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:06.827003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-820af56b-4f16-4cdd-b120-4d202a229bd4 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.149180 Jun 27 15:09:06.827563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1137/1387] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:06 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:07.844383 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-093ab396-2a6c-4dc9-8316-ac2afae8768b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:07.845572 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-093ab396-2a6c-4dc9-8316-ac2afae8768b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:07.851922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-093ab396-2a6c-4dc9-8316-ac2afae8768b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:07.852396 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-093ab396-2a6c-4dc9-8316-ac2afae8768b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:07.853160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-093ab396-2a6c-4dc9-8316-ac2afae8768b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:07.853588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-093ab396-2a6c-4dc9-8316-ac2afae8768b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:07.857474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:07.966277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:07.987582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-093ab396-2a6c-4dc9-8316-ac2afae8768b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:07.995140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-093ab396-2a6c-4dc9-8316-ac2afae8768b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.154608 Jun 27 15:09:07.995782 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1138/1388] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:07 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:09.012073 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b8f45fcf-7dab-48a6-82d6-6a911cb78025 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:09.012702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b8f45fcf-7dab-48a6-82d6-6a911cb78025 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:09.014801 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=8 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:09.020306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8f45fcf-7dab-48a6-82d6-6a911cb78025 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:09.020779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8f45fcf-7dab-48a6-82d6-6a911cb78025 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:09.021523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8f45fcf-7dab-48a6-82d6-6a911cb78025 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:09.021948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8f45fcf-7dab-48a6-82d6-6a911cb78025 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:09.154605 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b8f45fcf-7dab-48a6-82d6-6a911cb78025 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:09.161575 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b8f45fcf-7dab-48a6-82d6-6a911cb78025 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.153413 Jun 27 15:09:09.162120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1139/1389] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:09 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:10.178095 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d3f2ee3e-4565-402d-90a7-496c90bde5c2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:10.178735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d3f2ee3e-4565-402d-90a7-496c90bde5c2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:10.185169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d3f2ee3e-4565-402d-90a7-496c90bde5c2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:10.185611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d3f2ee3e-4565-402d-90a7-496c90bde5c2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:10.186354 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d3f2ee3e-4565-402d-90a7-496c90bde5c2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:10.186783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d3f2ee3e-4565-402d-90a7-496c90bde5c2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:10.318565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d3f2ee3e-4565-402d-90a7-496c90bde5c2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:10.325981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d3f2ee3e-4565-402d-90a7-496c90bde5c2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.151972 Jun 27 15:09:10.326537 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1140/1390] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:10 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:11.342792 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fbdd2f95-f197-46d6-a0ab-817d38d90923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:11.343406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fbdd2f95-f197-46d6-a0ab-817d38d90923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:11.350488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbdd2f95-f197-46d6-a0ab-817d38d90923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:11.350935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbdd2f95-f197-46d6-a0ab-817d38d90923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:11.351685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbdd2f95-f197-46d6-a0ab-817d38d90923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:11.352115 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fbdd2f95-f197-46d6-a0ab-817d38d90923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:11.484132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fbdd2f95-f197-46d6-a0ab-817d38d90923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:11.491726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fbdd2f95-f197-46d6-a0ab-817d38d90923 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.152829 Jun 27 15:09:11.492284 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1141/1391] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:11 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:12.508928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c146c979-6213-49fc-8f64-66daf25bfd3a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:12.509611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c146c979-6213-49fc-8f64-66daf25bfd3a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:12.515954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c146c979-6213-49fc-8f64-66daf25bfd3a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:12.516445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c146c979-6213-49fc-8f64-66daf25bfd3a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:12.517226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c146c979-6213-49fc-8f64-66daf25bfd3a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:12.517659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c146c979-6213-49fc-8f64-66daf25bfd3a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:12.649441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c146c979-6213-49fc-8f64-66daf25bfd3a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:12.656766 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c146c979-6213-49fc-8f64-66daf25bfd3a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.151633 Jun 27 15:09:12.657851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1142/1392] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:12 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:13.674637 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-08372524-f3a1-4525-9bb3-006ee143a0c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:13.675325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-08372524-f3a1-4525-9bb3-006ee143a0c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:13.681848 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08372524-f3a1-4525-9bb3-006ee143a0c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:13.682284 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08372524-f3a1-4525-9bb3-006ee143a0c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:13.683025 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08372524-f3a1-4525-9bb3-006ee143a0c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:13.683456 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08372524-f3a1-4525-9bb3-006ee143a0c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:13.816668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-08372524-f3a1-4525-9bb3-006ee143a0c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:13.824159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-08372524-f3a1-4525-9bb3-006ee143a0c7 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.154042 Jun 27 15:09:13.825159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1143/1393] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:13 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:14.841753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-79a60634-dfaf-47f0-b17a-6a2405cc50c1 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:14.842398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-79a60634-dfaf-47f0-b17a-6a2405cc50c1 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:14.849475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79a60634-dfaf-47f0-b17a-6a2405cc50c1 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:14.849915 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79a60634-dfaf-47f0-b17a-6a2405cc50c1 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:14.850656 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79a60634-dfaf-47f0-b17a-6a2405cc50c1 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:14.851082 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-79a60634-dfaf-47f0-b17a-6a2405cc50c1 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:14.979649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-79a60634-dfaf-47f0-b17a-6a2405cc50c1 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:14.987357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-79a60634-dfaf-47f0-b17a-6a2405cc50c1 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.149385 Jun 27 15:09:14.987859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1144/1394] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:14 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:16.004318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9d643682-da6a-42c7-aa35-683c1ae06cc9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:16.005052 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9d643682-da6a-42c7-aa35-683c1ae06cc9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:16.011319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9d643682-da6a-42c7-aa35-683c1ae06cc9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:16.011764 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9d643682-da6a-42c7-aa35-683c1ae06cc9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:16.012514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9d643682-da6a-42c7-aa35-683c1ae06cc9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:16.012975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9d643682-da6a-42c7-aa35-683c1ae06cc9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:16.147864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9d643682-da6a-42c7-aa35-683c1ae06cc9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:16.155547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9d643682-da6a-42c7-aa35-683c1ae06cc9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.155565 Jun 27 15:09:16.156119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1145/1395] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:15 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:16.995396 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-bece2829-ca06-4089-a6a7-1a25ae0ff835 req-1ab818c3-55ce-4284-871c-8e25a4bc38d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95dd20a9-56f2-45e8-918f-4be55af8daf5", "name": "network-vif-plugged", "status": "completed", "tag": "a9a30dca-ba32-42bd-87ab-d507a0394de8"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:09:17.004912 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-bece2829-ca06-4089-a6a7-1a25ae0ff835 req-1ab818c3-55ce-4284-871c-8e25a4bc38d0 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:17.005459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-bece2829-ca06-4089-a6a7-1a25ae0ff835 req-1ab818c3-55ce-4284-871c-8e25a4bc38d0 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:17.016263 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-bece2829-ca06-4089-a6a7-1a25ae0ff835 req-1ab818c3-55ce-4284-871c-8e25a4bc38d0 service nova] Creating event network-vif-plugged:a9a30dca-ba32-42bd-87ab-d507a0394de8 for instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 on hv-cinder-79760 Jun 27 15:09:17.021188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-bece2829-ca06-4089-a6a7-1a25ae0ff835 req-1ab818c3-55ce-4284-871c-8e25a4bc38d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029513 Jun 27 15:09:17.021771 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1146/1396] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:09:17.171940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8ecba879-2820-4c72-889b-4c0f53d29aab tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:17.172774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8ecba879-2820-4c72-889b-4c0f53d29aab tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:17.179266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8ecba879-2820-4c72-889b-4c0f53d29aab tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:17.179716 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8ecba879-2820-4c72-889b-4c0f53d29aab tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:17.180468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8ecba879-2820-4c72-889b-4c0f53d29aab tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:17.180930 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8ecba879-2820-4c72-889b-4c0f53d29aab tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:17.311849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8ecba879-2820-4c72-889b-4c0f53d29aab tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:17.321583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8ecba879-2820-4c72-889b-4c0f53d29aab tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.151876 Jun 27 15:09:17.321583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1147/1397] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:17 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:18.336465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9dccaaea-ba81-4643-93e5-9a09a6320100 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:18.337203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9dccaaea-ba81-4643-93e5-9a09a6320100 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:18.343726 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dccaaea-ba81-4643-93e5-9a09a6320100 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:18.344736 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dccaaea-ba81-4643-93e5-9a09a6320100 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:18.345626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dccaaea-ba81-4643-93e5-9a09a6320100 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:18.346050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9dccaaea-ba81-4643-93e5-9a09a6320100 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:18.479785 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9dccaaea-ba81-4643-93e5-9a09a6320100 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:18.487361 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9dccaaea-ba81-4643-93e5-9a09a6320100 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1267 microversion: 2.1 time: 0.154719 Jun 27 15:09:18.487928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1148/1398] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:18 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:19.503942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-be7dcbac-7e21-403e-8b96-8da778f54233 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:19.507429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-be7dcbac-7e21-403e-8b96-8da778f54233 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:19.511203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-be7dcbac-7e21-403e-8b96-8da778f54233 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:19.511668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-be7dcbac-7e21-403e-8b96-8da778f54233 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:19.512428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-be7dcbac-7e21-403e-8b96-8da778f54233 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:19.512920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-be7dcbac-7e21-403e-8b96-8da778f54233 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:19.651018 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-be7dcbac-7e21-403e-8b96-8da778f54233 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:19.659434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-be7dcbac-7e21-403e-8b96-8da778f54233 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1454 microversion: 2.1 time: 0.159728 Jun 27 15:09:19.659970 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1149/1399] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:19 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:19.675167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-94138177-fe8a-4020-a9b8-409c9c29da17 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:09:19.675922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-94138177-fe8a-4020-a9b8-409c9c29da17 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:09:19.682203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94138177-fe8a-4020-a9b8-409c9c29da17 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:19.683977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94138177-fe8a-4020-a9b8-409c9c29da17 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:19.683977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94138177-fe8a-4020-a9b8-409c9c29da17 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:19.683977 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-94138177-fe8a-4020-a9b8-409c9c29da17 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:19.824159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-94138177-fe8a-4020-a9b8-409c9c29da17 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:09:19.832114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-94138177-fe8a-4020-a9b8-409c9c29da17 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1454 microversion: 2.1 time: 0.160816 Jun 27 15:09:19.832699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1150/1400] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:09:19 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:09:21.880667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-f70d8a43-a2f6-49ce-9b8d-4dd0ea41dacf req-d30b1632-e742-487d-a32d-5e609457ec2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95dd20a9-56f2-45e8-918f-4be55af8daf5", "tag": "a9a30dca-ba32-42bd-87ab-d507a0394de8"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:09:21.884463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:21.889882 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f70d8a43-a2f6-49ce-9b8d-4dd0ea41dacf req-d30b1632-e742-487d-a32d-5e609457ec2c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:09:21.890320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-f70d8a43-a2f6-49ce-9b8d-4dd0ea41dacf req-d30b1632-e742-487d-a32d-5e609457ec2c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:09:21.902046 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-f70d8a43-a2f6-49ce-9b8d-4dd0ea41dacf req-d30b1632-e742-487d-a32d-5e609457ec2c service nova] Creating event network-changed:a9a30dca-ba32-42bd-87ab-d507a0394de8 for instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 on hv-cinder-79760 Jun 27 15:09:21.907702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-f70d8a43-a2f6-49ce-9b8d-4dd0ea41dacf req-d30b1632-e742-487d-a32d-5e609457ec2c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029895 Jun 27 15:09:21.909877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1151/1401] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:10:03.628554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8d407d5a-34de-4ba5-940a-7b9431c1b715 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:03.629298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8d407d5a-34de-4ba5-940a-7b9431c1b715 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:03.631277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=74 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:03.636461 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d407d5a-34de-4ba5-940a-7b9431c1b715 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:03.636923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d407d5a-34de-4ba5-940a-7b9431c1b715 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:03.637673 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d407d5a-34de-4ba5-940a-7b9431c1b715 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:03.638099 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d407d5a-34de-4ba5-940a-7b9431c1b715 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:03.660961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8d407d5a-34de-4ba5-940a-7b9431c1b715 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/ips" status: 200 len: 145 microversion: 2.1 time: 0.037147 Jun 27 15:10:03.661519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1152/1402] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:10:03 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:10:06.440311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6c7f4a74-3979-4cda-8b35-404dd94c62af tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85b915fc-b251-4235-8ec9-e6d360b8cb1c"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:10:06.441405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6c7f4a74-3979-4cda-8b35-404dd94c62af tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:06.449114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c7f4a74-3979-4cda-8b35-404dd94c62af tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:06.449554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c7f4a74-3979-4cda-8b35-404dd94c62af tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:06.450302 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c7f4a74-3979-4cda-8b35-404dd94c62af tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:06.450733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6c7f4a74-3979-4cda-8b35-404dd94c62af tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:07.179404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6c7f4a74-3979-4cda-8b35-404dd94c62af tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.742850 Jun 27 15:10:07.180090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1153/1403] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:10:06 2022] POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:10:14.655370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1cb9a1f5-dd32-48fb-b1fb-e773714c788a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:10:14.661589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1cb9a1f5-dd32-48fb-b1fb-e773714c788a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:14.662041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1cb9a1f5-dd32-48fb-b1fb-e773714c788a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:14.722036 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1cb9a1f5-dd32-48fb-b1fb-e773714c788a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Going to try to stop instance {{(pid=129687) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 15:10:14.902651 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1cb9a1f5-dd32-48fb-b1fb-e773714c788a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/action" status: 202 len: 0 microversion: 2.1 time: 0.252042 Jun 27 15:10:14.903311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1154/1404] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:10:14 2022] POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:10:14.911476 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-24af43dc-e5a3-4ef0-814c-186a6ddcf71b tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:14.913876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-24af43dc-e5a3-4ef0-814c-186a6ddcf71b tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:14.918524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24af43dc-e5a3-4ef0-814c-186a6ddcf71b tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:14.918969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24af43dc-e5a3-4ef0-814c-186a6ddcf71b tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:14.919722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24af43dc-e5a3-4ef0-814c-186a6ddcf71b tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:14.920154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-24af43dc-e5a3-4ef0-814c-186a6ddcf71b tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:15.053324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-24af43dc-e5a3-4ef0-814c-186a6ddcf71b tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:15.061943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-24af43dc-e5a3-4ef0-814c-186a6ddcf71b tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.154397 Jun 27 15:10:15.062860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1155/1405] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:14 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:16.079247 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9fb11c7b-3679-4b1d-8da6-9a832d1cb1ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:16.079940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9fb11c7b-3679-4b1d-8da6-9a832d1cb1ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:16.087112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9fb11c7b-3679-4b1d-8da6-9a832d1cb1ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:16.087494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9fb11c7b-3679-4b1d-8da6-9a832d1cb1ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:16.088251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9fb11c7b-3679-4b1d-8da6-9a832d1cb1ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:16.088711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9fb11c7b-3679-4b1d-8da6-9a832d1cb1ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:16.214350 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9fb11c7b-3679-4b1d-8da6-9a832d1cb1ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:16.222191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9fb11c7b-3679-4b1d-8da6-9a832d1cb1ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.146847 Jun 27 15:10:16.222747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1156/1406] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:16 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:17.239405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6724e31d-5904-4177-958b-a56db54dd1de tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:17.240060 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6724e31d-5904-4177-958b-a56db54dd1de tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:17.246504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6724e31d-5904-4177-958b-a56db54dd1de tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:17.246948 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6724e31d-5904-4177-958b-a56db54dd1de tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:17.247695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6724e31d-5904-4177-958b-a56db54dd1de tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:17.248126 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6724e31d-5904-4177-958b-a56db54dd1de tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:17.375552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6724e31d-5904-4177-958b-a56db54dd1de tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:17.384125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6724e31d-5904-4177-958b-a56db54dd1de tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.148577 Jun 27 15:10:17.384702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1157/1407] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:17 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:18.401860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5c1a6021-e786-4f27-81a5-c99ca09e73ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:18.402500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5c1a6021-e786-4f27-81a5-c99ca09e73ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:18.408856 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c1a6021-e786-4f27-81a5-c99ca09e73ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:18.409300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c1a6021-e786-4f27-81a5-c99ca09e73ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:18.410047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c1a6021-e786-4f27-81a5-c99ca09e73ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:18.410471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5c1a6021-e786-4f27-81a5-c99ca09e73ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:18.538429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5c1a6021-e786-4f27-81a5-c99ca09e73ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:18.547185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5c1a6021-e786-4f27-81a5-c99ca09e73ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.150029 Jun 27 15:10:18.547744 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1158/1408] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:18 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:19.565501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-16554d48-5981-4b1e-9fba-14812e83e615 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:19.566192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-16554d48-5981-4b1e-9fba-14812e83e615 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:19.573176 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-16554d48-5981-4b1e-9fba-14812e83e615 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:19.573615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-16554d48-5981-4b1e-9fba-14812e83e615 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:19.574355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-16554d48-5981-4b1e-9fba-14812e83e615 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:19.574783 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-16554d48-5981-4b1e-9fba-14812e83e615 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:19.704422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-16554d48-5981-4b1e-9fba-14812e83e615 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:19.713370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-16554d48-5981-4b1e-9fba-14812e83e615 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.151699 Jun 27 15:10:19.713935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1159/1409] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:19 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:20.731083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a9ec326-3ff6-4794-b25f-f96299f21d01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:20.731763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5a9ec326-3ff6-4794-b25f-f96299f21d01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:20.738152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a9ec326-3ff6-4794-b25f-f96299f21d01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:20.738599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a9ec326-3ff6-4794-b25f-f96299f21d01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:20.739356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a9ec326-3ff6-4794-b25f-f96299f21d01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:20.739787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a9ec326-3ff6-4794-b25f-f96299f21d01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:20.865798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5a9ec326-3ff6-4794-b25f-f96299f21d01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:20.873761 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5a9ec326-3ff6-4794-b25f-f96299f21d01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.147258 Jun 27 15:10:20.874328 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1160/1410] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:20 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:21.890508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4dc57031-3085-4663-8786-1ffa19a243ac tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:21.891213 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4dc57031-3085-4663-8786-1ffa19a243ac tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:21.897550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4dc57031-3085-4663-8786-1ffa19a243ac tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:21.897997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4dc57031-3085-4663-8786-1ffa19a243ac tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:21.899054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4dc57031-3085-4663-8786-1ffa19a243ac tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:21.899492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4dc57031-3085-4663-8786-1ffa19a243ac tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:22.031211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4dc57031-3085-4663-8786-1ffa19a243ac tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:22.039583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4dc57031-3085-4663-8786-1ffa19a243ac tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.152454 Jun 27 15:10:22.040142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1161/1411] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:21 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:23.057528 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0e920807-f2a0-4d07-b0c8-89095712fcdf tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:23.058183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0e920807-f2a0-4d07-b0c8-89095712fcdf tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:23.064532 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e920807-f2a0-4d07-b0c8-89095712fcdf tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:23.065007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e920807-f2a0-4d07-b0c8-89095712fcdf tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:23.065760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e920807-f2a0-4d07-b0c8-89095712fcdf tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:23.066190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0e920807-f2a0-4d07-b0c8-89095712fcdf tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:23.478916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0e920807-f2a0-4d07-b0c8-89095712fcdf tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:23.486711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0e920807-f2a0-4d07-b0c8-89095712fcdf tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.433752 Jun 27 15:10:23.487269 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1162/1412] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:23 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:24.503802 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3c7dec9a-612d-4e8f-b750-efd92560faf3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:24.504454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3c7dec9a-612d-4e8f-b750-efd92560faf3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:24.511015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c7dec9a-612d-4e8f-b750-efd92560faf3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:24.511453 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c7dec9a-612d-4e8f-b750-efd92560faf3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:24.512193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c7dec9a-612d-4e8f-b750-efd92560faf3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:24.512618 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3c7dec9a-612d-4e8f-b750-efd92560faf3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:24.638430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-3c7dec9a-612d-4e8f-b750-efd92560faf3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:24.646296 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3c7dec9a-612d-4e8f-b750-efd92560faf3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.146323 Jun 27 15:10:24.646851 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1163/1413] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:24 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:25.663448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f7612921-4ecb-444e-a942-2b41863fdf30 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:25.664125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f7612921-4ecb-444e-a942-2b41863fdf30 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:25.671226 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f7612921-4ecb-444e-a942-2b41863fdf30 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:25.671678 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f7612921-4ecb-444e-a942-2b41863fdf30 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:25.672427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f7612921-4ecb-444e-a942-2b41863fdf30 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:25.672891 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f7612921-4ecb-444e-a942-2b41863fdf30 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:25.806322 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f7612921-4ecb-444e-a942-2b41863fdf30 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:25.814143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f7612921-4ecb-444e-a942-2b41863fdf30 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.154610 Jun 27 15:10:25.814703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1164/1414] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:25 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:26.831288 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4353ed06-b95e-41cd-a623-1ff04645b6db tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:26.831989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4353ed06-b95e-41cd-a623-1ff04645b6db tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:26.838366 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4353ed06-b95e-41cd-a623-1ff04645b6db tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:26.838813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4353ed06-b95e-41cd-a623-1ff04645b6db tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:26.839560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4353ed06-b95e-41cd-a623-1ff04645b6db tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:26.839995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4353ed06-b95e-41cd-a623-1ff04645b6db tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:26.968203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4353ed06-b95e-41cd-a623-1ff04645b6db tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:26.976057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4353ed06-b95e-41cd-a623-1ff04645b6db tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.148761 Jun 27 15:10:26.976624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1165/1415] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:26 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:27.993524 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-73294ce9-9b80-48fd-a938-520355a29b01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:27.994212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-73294ce9-9b80-48fd-a938-520355a29b01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:28.000497 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73294ce9-9b80-48fd-a938-520355a29b01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:28.005613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73294ce9-9b80-48fd-a938-520355a29b01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:28.005613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73294ce9-9b80-48fd-a938-520355a29b01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:28.005613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-73294ce9-9b80-48fd-a938-520355a29b01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:28.020199 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:28.136920 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-73294ce9-9b80-48fd-a938-520355a29b01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:28.144953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-73294ce9-9b80-48fd-a938-520355a29b01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.155441 Jun 27 15:10:28.145517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1166/1416] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:27 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:29.161934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-08c8152c-4861-4412-b75c-685d795bbba9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:29.162569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-08c8152c-4861-4412-b75c-685d795bbba9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:29.169632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08c8152c-4861-4412-b75c-685d795bbba9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:29.170074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08c8152c-4861-4412-b75c-685d795bbba9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:29.170820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08c8152c-4861-4412-b75c-685d795bbba9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:29.171254 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08c8152c-4861-4412-b75c-685d795bbba9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:29.296673 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-08c8152c-4861-4412-b75c-685d795bbba9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:29.304874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-08c8152c-4861-4412-b75c-685d795bbba9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.146749 Jun 27 15:10:29.305442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1167/1417] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:29 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:30.322229 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e1012d52-d351-404e-9d2e-82419b63962a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:30.322839 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e1012d52-d351-404e-9d2e-82419b63962a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:30.329481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1012d52-d351-404e-9d2e-82419b63962a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:30.334164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1012d52-d351-404e-9d2e-82419b63962a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:30.334164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1012d52-d351-404e-9d2e-82419b63962a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:30.334164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1012d52-d351-404e-9d2e-82419b63962a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:30.467276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e1012d52-d351-404e-9d2e-82419b63962a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:30.475192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e1012d52-d351-404e-9d2e-82419b63962a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1723 microversion: 2.1 time: 0.156917 Jun 27 15:10:30.475760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1168/1418] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:30 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:31.493741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ace97050-6294-4fe4-b943-4142977c4529 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:31.494432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ace97050-6294-4fe4-b943-4142977c4529 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:31.500691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ace97050-6294-4fe4-b943-4142977c4529 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:31.501134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ace97050-6294-4fe4-b943-4142977c4529 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:31.501873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ace97050-6294-4fe4-b943-4142977c4529 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:31.502297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ace97050-6294-4fe4-b943-4142977c4529 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:31.628047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ace97050-6294-4fe4-b943-4142977c4529 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:31.635958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ace97050-6294-4fe4-b943-4142977c4529 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1700 microversion: 2.1 time: 0.146810 Jun 27 15:10:31.636515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1169/1419] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:31 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1700 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:10:31.651451 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-26020535-3757-41b7-9a9b-5ca4fd6780ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:10:31.657142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-26020535-3757-41b7-9a9b-5ca4fd6780ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:31.657587 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-26020535-3757-41b7-9a9b-5ca4fd6780ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:31.679099 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-26020535-3757-41b7-9a9b-5ca4fd6780ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Going to try to start instance {{(pid=129687) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 15:10:31.896981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-26020535-3757-41b7-9a9b-5ca4fd6780ef tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/action" status: 202 len: 0 microversion: 2.1 time: 0.248801 Jun 27 15:10:31.897616 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1170/1420] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:10:31 2022] POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:10:31.906715 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ae05bd2f-a567-4893-89f9-8d3e506161c6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:31.907395 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ae05bd2f-a567-4893-89f9-8d3e506161c6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:31.913588 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ae05bd2f-a567-4893-89f9-8d3e506161c6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:31.916100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ae05bd2f-a567-4893-89f9-8d3e506161c6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:31.916100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ae05bd2f-a567-4893-89f9-8d3e506161c6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:31.916100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ae05bd2f-a567-4893-89f9-8d3e506161c6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:32.047184 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ae05bd2f-a567-4893-89f9-8d3e506161c6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:32.055632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ae05bd2f-a567-4893-89f9-8d3e506161c6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1709 microversion: 2.1 time: 0.152966 Jun 27 15:10:32.056132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1171/1421] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:31 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:33.073277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8df78a3b-ff12-46fd-93b8-d69b7774c0ed tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:33.073995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8df78a3b-ff12-46fd-93b8-d69b7774c0ed tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:33.080241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8df78a3b-ff12-46fd-93b8-d69b7774c0ed tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:33.080720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8df78a3b-ff12-46fd-93b8-d69b7774c0ed tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:33.081474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8df78a3b-ff12-46fd-93b8-d69b7774c0ed tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:33.081905 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8df78a3b-ff12-46fd-93b8-d69b7774c0ed tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:33.214746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8df78a3b-ff12-46fd-93b8-d69b7774c0ed tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:33.222488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8df78a3b-ff12-46fd-93b8-d69b7774c0ed tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1709 microversion: 2.1 time: 0.153101 Jun 27 15:10:33.223037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1172/1422] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:33 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:34.241774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5aa62015-29f0-4908-bfe8-ab6681994c97 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:10:34.244043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5aa62015-29f0-4908-bfe8-ab6681994c97 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:10:34.249487 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5aa62015-29f0-4908-bfe8-ab6681994c97 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:34.249928 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5aa62015-29f0-4908-bfe8-ab6681994c97 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:34.250667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5aa62015-29f0-4908-bfe8-ab6681994c97 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:10:34.251089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5aa62015-29f0-4908-bfe8-ab6681994c97 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:10:34.377946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5aa62015-29f0-4908-bfe8-ab6681994c97 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:10:34.386721 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5aa62015-29f0-4908-bfe8-ab6681994c97 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1713 microversion: 2.1 time: 0.149282 Jun 27 15:10:34.387277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1173/1423] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:10:34 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:10:52.266106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:10:52.266698 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Mon Jun 27 15:10:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:11:01.777378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:11:01.777947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Mon Jun 27 15:11:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:11:30.165445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b89c36a4-f34c-4444-ae2a-83f70e7e691d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:30.166165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b89c36a4-f34c-4444-ae2a-83f70e7e691d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:30.168357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=45 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:30.169071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:30.174259 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b89c36a4-f34c-4444-ae2a-83f70e7e691d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:30.174700 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b89c36a4-f34c-4444-ae2a-83f70e7e691d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:30.175710 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b89c36a4-f34c-4444-ae2a-83f70e7e691d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:30.176133 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b89c36a4-f34c-4444-ae2a-83f70e7e691d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:30.402151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-b89c36a4-f34c-4444-ae2a-83f70e7e691d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lazy-loading 'services' on Instance uuid da9fd2bf-be40-498e-94d5-8ea8e588bcba {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:11:30.618936 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b89c36a4-f34c-4444-ae2a-83f70e7e691d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "DELETE /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/os-volume_attachments/85b915fc-b251-4235-8ec9-e6d360b8cb1c" status: 202 len: 0 microversion: 2.1 time: 0.457384 Jun 27 15:11:30.619832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1174/1424] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:11:30 2022] DELETE /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/os-volume_attachments/85b915fc-b251-4235-8ec9-e6d360b8cb1c => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:11:35.850574 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-567270662", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1387064064", "security_groups": [{"name": "tempest-secgroup-smoke-2040048435"}], "block_device_mapping_v2": [{"uuid": "0533e865-db3f-46a7-ba37-4790890ef6f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "102de29a-dcd6-421f-8631-f35b90da1246"}]}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:11:35.966542 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] validate_networks() for [('102de29a-dcd6-421f-8631-f35b90da1246', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:11:36.331685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:11:36.332137 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:11:36.332606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:11:36.333043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:11:36.333479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:11:36.342127 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:36.342575 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:36.343363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:36.343797 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:36.359881 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Getting quotas for project 2bba2dfe000d427b9ab9dff2601436f1. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:11:36.363759 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Getting quotas for user e6357e83df904ea09221cfc374d776c4 and project 2bba2dfe000d427b9ab9dff2601436f1. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:11:36.420157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:11:36.422369 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0533e865-db3f-46a7-ba37-4790890ef6f2',volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:11:36.848837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-431d9b81-4266-474e-a2c2-f6280457db1a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.003044 Jun 27 15:11:36.849471 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1175/1425] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:11:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:11:36.854709 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-56cae5ac-c81a-4e75-9cc6-db9c5da42b9d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:11:36.862167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-56cae5ac-c81a-4e75-9cc6-db9c5da42b9d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:36.862601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-56cae5ac-c81a-4e75-9cc6-db9c5da42b9d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:36.886037 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-56cae5ac-c81a-4e75-9cc6-db9c5da42b9d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Going to try to stop instance {{(pid=129687) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 15:11:37.061565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-56cae5ac-c81a-4e75-9cc6-db9c5da42b9d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/action" status: 202 len: 0 microversion: 2.1 time: 0.210817 Jun 27 15:11:37.062112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1176/1426] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:11:36 2022] POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:11:37.067325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-aa26786d-a3df-4f9e-9b7c-1a610c96ea63 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:37.068185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-aa26786d-a3df-4f9e-9b7c-1a610c96ea63 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:37.122746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-aa26786d-a3df-4f9e-9b7c-1a610c96ea63 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:37.129424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-aa26786d-a3df-4f9e-9b7c-1a610c96ea63 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1094 microversion: 2.1 time: 0.066226 Jun 27 15:11:37.129985 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1177/1427] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:37 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:37.134827 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2c5ee6d9-ca3f-4850-9b82-4130cc1894fc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:37.135432 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2c5ee6d9-ca3f-4850-9b82-4130cc1894fc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:37.142252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2c5ee6d9-ca3f-4850-9b82-4130cc1894fc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:37.146324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2c5ee6d9-ca3f-4850-9b82-4130cc1894fc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:37.146324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2c5ee6d9-ca3f-4850-9b82-4130cc1894fc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:37.146324 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2c5ee6d9-ca3f-4850-9b82-4130cc1894fc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:37.281648 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2c5ee6d9-ca3f-4850-9b82-4130cc1894fc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:37.289072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2c5ee6d9-ca3f-4850-9b82-4130cc1894fc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.158048 Jun 27 15:11:37.291975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1178/1428] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:37 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:38.146283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e7c9a5a3-9b34-429c-a596-c982e7f4b16c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:38.146926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e7c9a5a3-9b34-429c-a596-c982e7f4b16c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:38.153424 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e7c9a5a3-9b34-429c-a596-c982e7f4b16c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:38.153904 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e7c9a5a3-9b34-429c-a596-c982e7f4b16c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:38.154647 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e7c9a5a3-9b34-429c-a596-c982e7f4b16c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:38.155075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e7c9a5a3-9b34-429c-a596-c982e7f4b16c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:38.219625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e7c9a5a3-9b34-429c-a596-c982e7f4b16c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:38.226943 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e7c9a5a3-9b34-429c-a596-c982e7f4b16c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1136 microversion: 2.1 time: 0.084542 Jun 27 15:11:38.232178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1179/1429] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:38 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:38.306907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-17e91b7a-0790-4361-8896-a013e055627a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:38.307459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-17e91b7a-0790-4361-8896-a013e055627a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:38.314272 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17e91b7a-0790-4361-8896-a013e055627a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:38.314712 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17e91b7a-0790-4361-8896-a013e055627a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:38.315454 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17e91b7a-0790-4361-8896-a013e055627a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:38.315880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-17e91b7a-0790-4361-8896-a013e055627a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:38.443603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-17e91b7a-0790-4361-8896-a013e055627a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:38.451428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-17e91b7a-0790-4361-8896-a013e055627a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.148329 Jun 27 15:11:38.451987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1180/1430] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:38 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:39.244126 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e66487f7-b706-4813-a606-21fee6d7cce8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:39.245568 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e66487f7-b706-4813-a606-21fee6d7cce8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:39.252769 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e66487f7-b706-4813-a606-21fee6d7cce8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:39.257691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e66487f7-b706-4813-a606-21fee6d7cce8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:39.257691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e66487f7-b706-4813-a606-21fee6d7cce8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:39.257691 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e66487f7-b706-4813-a606-21fee6d7cce8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:39.327306 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e66487f7-b706-4813-a606-21fee6d7cce8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:39.334743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e66487f7-b706-4813-a606-21fee6d7cce8 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1210 microversion: 2.1 time: 0.094637 Jun 27 15:11:39.336997 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1181/1431] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:39 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:39.468223 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9a58630f-71c3-426d-8815-44fae427d059 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:39.468953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9a58630f-71c3-426d-8815-44fae427d059 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:39.474787 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9a58630f-71c3-426d-8815-44fae427d059 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:39.475230 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9a58630f-71c3-426d-8815-44fae427d059 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:39.475971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9a58630f-71c3-426d-8815-44fae427d059 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:39.476401 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9a58630f-71c3-426d-8815-44fae427d059 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:39.726536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9a58630f-71c3-426d-8815-44fae427d059 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:39.734746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9a58630f-71c3-426d-8815-44fae427d059 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.270350 Jun 27 15:11:39.735610 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1182/1432] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:39 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:40.352051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b4669c4b-9bcc-40d6-92af-7ff1f239400f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:40.352763 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b4669c4b-9bcc-40d6-92af-7ff1f239400f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:40.359097 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4669c4b-9bcc-40d6-92af-7ff1f239400f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:40.359544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4669c4b-9bcc-40d6-92af-7ff1f239400f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:40.360308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4669c4b-9bcc-40d6-92af-7ff1f239400f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:40.360768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b4669c4b-9bcc-40d6-92af-7ff1f239400f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:40.570021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b4669c4b-9bcc-40d6-92af-7ff1f239400f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:40.578753 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b4669c4b-9bcc-40d6-92af-7ff1f239400f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.230473 Jun 27 15:11:40.579320 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1183/1433] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:40 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:40.753204 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-ebf176b8-7c49-4c5f-a61b-24d811edfd3e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:40.754015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-ebf176b8-7c49-4c5f-a61b-24d811edfd3e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:40.761240 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebf176b8-7c49-4c5f-a61b-24d811edfd3e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:40.762243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebf176b8-7c49-4c5f-a61b-24d811edfd3e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:40.771596 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebf176b8-7c49-4c5f-a61b-24d811edfd3e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:40.772145 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-ebf176b8-7c49-4c5f-a61b-24d811edfd3e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:40.950502 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-ebf176b8-7c49-4c5f-a61b-24d811edfd3e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:40.957876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-ebf176b8-7c49-4c5f-a61b-24d811edfd3e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.208800 Jun 27 15:11:40.958438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1184/1434] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:40 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:40.963901 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-6857f948-9ed6-4bb2-bbeb-3dda1d04b1b7 req-76c44ce4-b4ae-4903-9cfe-0e386e9803e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9b72b3-b17b-4750-b7d7-0ff8cfb748be", "tag": "fa16b275-b3c0-487a-9c0c-7c682ebcc923"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:11:40.972435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6857f948-9ed6-4bb2-bbeb-3dda1d04b1b7 req-76c44ce4-b4ae-4903-9cfe-0e386e9803e3 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:40.972989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-6857f948-9ed6-4bb2-bbeb-3dda1d04b1b7 req-76c44ce4-b4ae-4903-9cfe-0e386e9803e3 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:40.985301 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-6857f948-9ed6-4bb2-bbeb-3dda1d04b1b7 req-76c44ce4-b4ae-4903-9cfe-0e386e9803e3 service nova] Creating event network-changed:fa16b275-b3c0-487a-9c0c-7c682ebcc923 for instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be on hv-cinder-79760 Jun 27 15:11:40.990325 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-6857f948-9ed6-4bb2-bbeb-3dda1d04b1b7 req-76c44ce4-b4ae-4903-9cfe-0e386e9803e3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030761 Jun 27 15:11:40.990939 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1185/1435] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:11:41.596063 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9662d724-b984-4ff5-8537-418dd328eff3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:41.596812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9662d724-b984-4ff5-8537-418dd328eff3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:41.603446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9662d724-b984-4ff5-8537-418dd328eff3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:41.603896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9662d724-b984-4ff5-8537-418dd328eff3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:41.604661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9662d724-b984-4ff5-8537-418dd328eff3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:41.605112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9662d724-b984-4ff5-8537-418dd328eff3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:41.733307 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9662d724-b984-4ff5-8537-418dd328eff3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:41.740740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9662d724-b984-4ff5-8537-418dd328eff3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.148954 Jun 27 15:11:41.741312 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1186/1436] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:41 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:41.975991 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4b201512-dc5c-4df4-abc9-29b4d1c46ab6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:41.976629 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4b201512-dc5c-4df4-abc9-29b4d1c46ab6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:41.982594 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b201512-dc5c-4df4-abc9-29b4d1c46ab6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:41.983041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b201512-dc5c-4df4-abc9-29b4d1c46ab6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:41.983791 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b201512-dc5c-4df4-abc9-29b4d1c46ab6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:41.984256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4b201512-dc5c-4df4-abc9-29b4d1c46ab6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:42.110999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4b201512-dc5c-4df4-abc9-29b4d1c46ab6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:42.118488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4b201512-dc5c-4df4-abc9-29b4d1c46ab6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.146316 Jun 27 15:11:42.119049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1187/1437] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:41 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:42.756482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8fc4cedf-f880-4df9-86d0-d35605be9bad tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:42.758143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8fc4cedf-f880-4df9-86d0-d35605be9bad tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:42.763437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8fc4cedf-f880-4df9-86d0-d35605be9bad tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:42.763883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8fc4cedf-f880-4df9-86d0-d35605be9bad tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:42.764659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8fc4cedf-f880-4df9-86d0-d35605be9bad tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:42.765102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8fc4cedf-f880-4df9-86d0-d35605be9bad tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:42.955185 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8fc4cedf-f880-4df9-86d0-d35605be9bad tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:42.962628 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8fc4cedf-f880-4df9-86d0-d35605be9bad tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.209975 Jun 27 15:11:42.963191 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1188/1438] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:42 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:43.135149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d1be6c97-829b-46f7-acee-08da062d774c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:43.135747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-d1be6c97-829b-46f7-acee-08da062d774c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:43.141860 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1be6c97-829b-46f7-acee-08da062d774c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:43.142298 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1be6c97-829b-46f7-acee-08da062d774c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:43.143041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1be6c97-829b-46f7-acee-08da062d774c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:43.143463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-d1be6c97-829b-46f7-acee-08da062d774c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:43.269111 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-d1be6c97-829b-46f7-acee-08da062d774c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:43.276421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d1be6c97-829b-46f7-acee-08da062d774c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.145111 Jun 27 15:11:43.277583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1189/1439] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:43 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:43.979559 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-58994d0e-58e5-4c29-9b9c-eefaf0a245c3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:43.980283 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-58994d0e-58e5-4c29-9b9c-eefaf0a245c3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:43.986864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-58994d0e-58e5-4c29-9b9c-eefaf0a245c3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:43.987305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-58994d0e-58e5-4c29-9b9c-eefaf0a245c3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:43.988074 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-58994d0e-58e5-4c29-9b9c-eefaf0a245c3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:43.988498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-58994d0e-58e5-4c29-9b9c-eefaf0a245c3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:44.121813 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-58994d0e-58e5-4c29-9b9c-eefaf0a245c3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:44.129291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-58994d0e-58e5-4c29-9b9c-eefaf0a245c3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.153753 Jun 27 15:11:44.129849 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1190/1440] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:43 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:44.294015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4e1d5541-fac7-4665-a5c8-0df37a0980ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:44.294544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4e1d5541-fac7-4665-a5c8-0df37a0980ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:44.300592 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e1d5541-fac7-4665-a5c8-0df37a0980ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:44.301064 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e1d5541-fac7-4665-a5c8-0df37a0980ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:44.301806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e1d5541-fac7-4665-a5c8-0df37a0980ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:44.302235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4e1d5541-fac7-4665-a5c8-0df37a0980ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:44.306149 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:44.428376 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4e1d5541-fac7-4665-a5c8-0df37a0980ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:44.436455 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4e1d5541-fac7-4665-a5c8-0df37a0980ec tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.146678 Jun 27 15:11:44.437048 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1191/1441] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:44 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:45.145081 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-78798347-8d12-4a16-9c3a-d0d9c4f8015b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:45.145682 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-78798347-8d12-4a16-9c3a-d0d9c4f8015b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:45.152262 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78798347-8d12-4a16-9c3a-d0d9c4f8015b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:45.153019 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78798347-8d12-4a16-9c3a-d0d9c4f8015b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:45.153779 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78798347-8d12-4a16-9c3a-d0d9c4f8015b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:45.154219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78798347-8d12-4a16-9c3a-d0d9c4f8015b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:45.284975 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-78798347-8d12-4a16-9c3a-d0d9c4f8015b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:45.293172 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-78798347-8d12-4a16-9c3a-d0d9c4f8015b tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.151321 Jun 27 15:11:45.293922 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1192/1442] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:45 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:45.453546 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-df4a82f5-2dda-4451-aca2-3edf370e80e0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:45.454177 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-df4a82f5-2dda-4451-aca2-3edf370e80e0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:45.460002 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df4a82f5-2dda-4451-aca2-3edf370e80e0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:45.460443 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df4a82f5-2dda-4451-aca2-3edf370e80e0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:45.461234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df4a82f5-2dda-4451-aca2-3edf370e80e0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:45.461661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-df4a82f5-2dda-4451-aca2-3edf370e80e0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:45.592417 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-df4a82f5-2dda-4451-aca2-3edf370e80e0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:45.599781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-df4a82f5-2dda-4451-aca2-3edf370e80e0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.150419 Jun 27 15:11:45.600345 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1193/1443] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:45 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:46.310206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-19b60845-3770-4fde-9da0-12c246ffcf0a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:46.310821 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-19b60845-3770-4fde-9da0-12c246ffcf0a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:46.317219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19b60845-3770-4fde-9da0-12c246ffcf0a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:46.317665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19b60845-3770-4fde-9da0-12c246ffcf0a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:46.318410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19b60845-3770-4fde-9da0-12c246ffcf0a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:46.318847 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19b60845-3770-4fde-9da0-12c246ffcf0a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:46.350431 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:46.448244 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-19b60845-3770-4fde-9da0-12c246ffcf0a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:46.456201 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-19b60845-3770-4fde-9da0-12c246ffcf0a tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.149932 Jun 27 15:11:46.456855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1194/1444] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:46 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:46.616573 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-81dae9fe-1e87-4687-8940-02d797c4d134 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:46.617195 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-81dae9fe-1e87-4687-8940-02d797c4d134 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:46.623331 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81dae9fe-1e87-4687-8940-02d797c4d134 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:46.623776 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81dae9fe-1e87-4687-8940-02d797c4d134 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:46.624519 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81dae9fe-1e87-4687-8940-02d797c4d134 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:46.624976 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-81dae9fe-1e87-4687-8940-02d797c4d134 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:46.755438 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-81dae9fe-1e87-4687-8940-02d797c4d134 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:46.763396 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-81dae9fe-1e87-4687-8940-02d797c4d134 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.150626 Jun 27 15:11:46.763951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1195/1445] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:46 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:47.473641 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6801f94c-5932-4ed1-ab70-648e004ea603 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:47.474340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6801f94c-5932-4ed1-ab70-648e004ea603 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:47.476123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=8 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:47.482151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6801f94c-5932-4ed1-ab70-648e004ea603 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:47.482601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6801f94c-5932-4ed1-ab70-648e004ea603 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:47.483355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6801f94c-5932-4ed1-ab70-648e004ea603 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:47.483793 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6801f94c-5932-4ed1-ab70-648e004ea603 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:47.615833 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-6801f94c-5932-4ed1-ab70-648e004ea603 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:47.623231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6801f94c-5932-4ed1-ab70-648e004ea603 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.153474 Jun 27 15:11:47.623790 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1196/1446] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:47 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:47.780699 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bf83e752-dd61-4c3b-bc7a-8bdd5e0696ab tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:47.781336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-bf83e752-dd61-4c3b-bc7a-8bdd5e0696ab tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:47.787260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf83e752-dd61-4c3b-bc7a-8bdd5e0696ab tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:47.787696 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf83e752-dd61-4c3b-bc7a-8bdd5e0696ab tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:47.788434 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf83e752-dd61-4c3b-bc7a-8bdd5e0696ab tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:47.788903 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-bf83e752-dd61-4c3b-bc7a-8bdd5e0696ab tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:47.917972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-bf83e752-dd61-4c3b-bc7a-8bdd5e0696ab tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:47.925685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bf83e752-dd61-4c3b-bc7a-8bdd5e0696ab tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.149252 Jun 27 15:11:47.926248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1197/1447] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:47 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:48.639489 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e9d18607-9a93-44d1-bea2-fb32c3d9ebd2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:48.640140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e9d18607-9a93-44d1-bea2-fb32c3d9ebd2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:48.646527 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9d18607-9a93-44d1-bea2-fb32c3d9ebd2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:48.646972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9d18607-9a93-44d1-bea2-fb32c3d9ebd2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:48.647719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9d18607-9a93-44d1-bea2-fb32c3d9ebd2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:48.648147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e9d18607-9a93-44d1-bea2-fb32c3d9ebd2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:48.776412 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e9d18607-9a93-44d1-bea2-fb32c3d9ebd2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:48.783803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e9d18607-9a93-44d1-bea2-fb32c3d9ebd2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.148298 Jun 27 15:11:48.784363 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1198/1448] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:48 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:48.942627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4d97bdd1-29e5-44e0-acc8-dd3b93e8bf0c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:48.943251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4d97bdd1-29e5-44e0-acc8-dd3b93e8bf0c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:48.949130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d97bdd1-29e5-44e0-acc8-dd3b93e8bf0c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:48.950370 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d97bdd1-29e5-44e0-acc8-dd3b93e8bf0c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:48.951319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d97bdd1-29e5-44e0-acc8-dd3b93e8bf0c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:48.951729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4d97bdd1-29e5-44e0-acc8-dd3b93e8bf0c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:49.078812 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4d97bdd1-29e5-44e0-acc8-dd3b93e8bf0c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:49.086685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4d97bdd1-29e5-44e0-acc8-dd3b93e8bf0c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.147847 Jun 27 15:11:49.087265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1199/1449] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:48 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:49.801015 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fec7cd57-ae58-48c8-aa8d-e6a3f3cab7a9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:49.801715 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fec7cd57-ae58-48c8-aa8d-e6a3f3cab7a9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:49.808002 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fec7cd57-ae58-48c8-aa8d-e6a3f3cab7a9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:49.808447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fec7cd57-ae58-48c8-aa8d-e6a3f3cab7a9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:49.809459 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fec7cd57-ae58-48c8-aa8d-e6a3f3cab7a9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:49.809923 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fec7cd57-ae58-48c8-aa8d-e6a3f3cab7a9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:49.944050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fec7cd57-ae58-48c8-aa8d-e6a3f3cab7a9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:49.951426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fec7cd57-ae58-48c8-aa8d-e6a3f3cab7a9 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.154605 Jun 27 15:11:49.951990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1200/1450] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:49 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:50.103956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-95cdbee9-6a14-4c50-bfea-216d7f4664cd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:50.104611 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-95cdbee9-6a14-4c50-bfea-216d7f4664cd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:50.110859 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-95cdbee9-6a14-4c50-bfea-216d7f4664cd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:50.111300 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-95cdbee9-6a14-4c50-bfea-216d7f4664cd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:50.112043 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-95cdbee9-6a14-4c50-bfea-216d7f4664cd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:50.112500 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-95cdbee9-6a14-4c50-bfea-216d7f4664cd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:50.238066 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-95cdbee9-6a14-4c50-bfea-216d7f4664cd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:50.245398 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-95cdbee9-6a14-4c50-bfea-216d7f4664cd tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.145414 Jun 27 15:11:50.245963 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1201/1451] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:50 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:50.968311 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9e693325-0c26-4c3f-b578-d39f27cd82b3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:50.969050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9e693325-0c26-4c3f-b578-d39f27cd82b3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:50.975364 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e693325-0c26-4c3f-b578-d39f27cd82b3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:50.975805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e693325-0c26-4c3f-b578-d39f27cd82b3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:50.976544 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e693325-0c26-4c3f-b578-d39f27cd82b3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:50.976992 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e693325-0c26-4c3f-b578-d39f27cd82b3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:51.108776 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9e693325-0c26-4c3f-b578-d39f27cd82b3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:51.116178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9e693325-0c26-4c3f-b578-d39f27cd82b3 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.151814 Jun 27 15:11:51.116745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1202/1452] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:50 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:51.261399 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-de723c91-b8e6-4c1a-8bfa-15dd69549123 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:51.261946 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-de723c91-b8e6-4c1a-8bfa-15dd69549123 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:51.268045 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de723c91-b8e6-4c1a-8bfa-15dd69549123 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:51.268494 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de723c91-b8e6-4c1a-8bfa-15dd69549123 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:51.269291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de723c91-b8e6-4c1a-8bfa-15dd69549123 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:51.269731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-de723c91-b8e6-4c1a-8bfa-15dd69549123 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:51.401178 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-de723c91-b8e6-4c1a-8bfa-15dd69549123 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:51.405774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-de723c91-b8e6-4c1a-8bfa-15dd69549123 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1677 microversion: 2.1 time: 0.148078 Jun 27 15:11:51.406333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1203/1453] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:51 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:51.862190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-5d451c1a-fec1-4dd3-b447-96793d5d061b req-bcba911d-818a-4146-9448-c0afc69c6aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9b72b3-b17b-4750-b7d7-0ff8cfb748be", "name": "network-vif-plugged", "status": "completed", "tag": "fa16b275-b3c0-487a-9c0c-7c682ebcc923"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:11:51.869990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5d451c1a-fec1-4dd3-b447-96793d5d061b req-bcba911d-818a-4146-9448-c0afc69c6aa2 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:51.870423 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5d451c1a-fec1-4dd3-b447-96793d5d061b req-bcba911d-818a-4146-9448-c0afc69c6aa2 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:51.881215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-5d451c1a-fec1-4dd3-b447-96793d5d061b req-bcba911d-818a-4146-9448-c0afc69c6aa2 service nova] Creating event network-vif-plugged:fa16b275-b3c0-487a-9c0c-7c682ebcc923 for instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be on hv-cinder-79760 Jun 27 15:11:51.886090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-5d451c1a-fec1-4dd3-b447-96793d5d061b req-bcba911d-818a-4146-9448-c0afc69c6aa2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027783 Jun 27 15:11:51.886667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1204/1454] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:11:52.133215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e31a47ae-a218-41f5-8ff2-0dcc479f6430 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:52.143507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e31a47ae-a218-41f5-8ff2-0dcc479f6430 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:52.143507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e31a47ae-a218-41f5-8ff2-0dcc479f6430 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:52.143507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e31a47ae-a218-41f5-8ff2-0dcc479f6430 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:52.143507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e31a47ae-a218-41f5-8ff2-0dcc479f6430 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:52.143908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e31a47ae-a218-41f5-8ff2-0dcc479f6430 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:52.599047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e31a47ae-a218-41f5-8ff2-0dcc479f6430 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:52.612810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e31a47ae-a218-41f5-8ff2-0dcc479f6430 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.477958 Jun 27 15:11:52.612810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1205/1455] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:52 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:52.612810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f889ed76-27d5-42f1-84dd-5d0d3e391c32 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:52.612810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f889ed76-27d5-42f1-84dd-5d0d3e391c32 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:52.618352 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f889ed76-27d5-42f1-84dd-5d0d3e391c32 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:52.618795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f889ed76-27d5-42f1-84dd-5d0d3e391c32 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:52.619569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f889ed76-27d5-42f1-84dd-5d0d3e391c32 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:52.619958 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f889ed76-27d5-42f1-84dd-5d0d3e391c32 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:52.750330 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f889ed76-27d5-42f1-84dd-5d0d3e391c32 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:52.754659 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f889ed76-27d5-42f1-84dd-5d0d3e391c32 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1654 microversion: 2.1 time: 0.146195 Jun 27 15:11:52.755234 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1206/1456] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:52 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:11:52.771214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-15b5f368-bfab-48ce-894c-56e8e1cfe49e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:11:52.777305 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-15b5f368-bfab-48ce-894c-56e8e1cfe49e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:52.778188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-15b5f368-bfab-48ce-894c-56e8e1cfe49e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:52.801041 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-15b5f368-bfab-48ce-894c-56e8e1cfe49e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Going to try to start instance {{(pid=129687) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 15:11:52.826472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:52.958589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-15b5f368-bfab-48ce-894c-56e8e1cfe49e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/action" status: 202 len: 0 microversion: 2.1 time: 0.190814 Jun 27 15:11:52.959182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1207/1457] 10.222.0.44 () {60 vars in 1277 bytes} [Mon Jun 27 15:11:52 2022] POST /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:11:52.967317 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8d011d2d-0772-4aac-aa50-c61edb64a5b8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:52.968005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8d011d2d-0772-4aac-aa50-c61edb64a5b8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:52.974106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d011d2d-0772-4aac-aa50-c61edb64a5b8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:52.974584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d011d2d-0772-4aac-aa50-c61edb64a5b8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:52.975333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d011d2d-0772-4aac-aa50-c61edb64a5b8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:52.975760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8d011d2d-0772-4aac-aa50-c61edb64a5b8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:53.111042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8d011d2d-0772-4aac-aa50-c61edb64a5b8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:53.118562 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8d011d2d-0772-4aac-aa50-c61edb64a5b8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1663 microversion: 2.1 time: 0.155264 Jun 27 15:11:53.119123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1208/1458] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:52 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:53.623272 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-18695f65-53f9-4c00-b430-fa11d774159d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:53.623947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-18695f65-53f9-4c00-b430-fa11d774159d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:53.629940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18695f65-53f9-4c00-b430-fa11d774159d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:53.631171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18695f65-53f9-4c00-b430-fa11d774159d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:53.632326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18695f65-53f9-4c00-b430-fa11d774159d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:53.632781 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-18695f65-53f9-4c00-b430-fa11d774159d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:53.803907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-18695f65-53f9-4c00-b430-fa11d774159d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:53.815321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-18695f65-53f9-4c00-b430-fa11d774159d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1266 microversion: 2.1 time: 0.192428 Jun 27 15:11:53.815321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1209/1459] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:53 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:54.136560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b8ec164f-f030-4b90-bf94-454c1607bd01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:54.137741 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b8ec164f-f030-4b90-bf94-454c1607bd01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:54.144167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8ec164f-f030-4b90-bf94-454c1607bd01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:54.144606 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8ec164f-f030-4b90-bf94-454c1607bd01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:54.145491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8ec164f-f030-4b90-bf94-454c1607bd01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:54.145917 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b8ec164f-f030-4b90-bf94-454c1607bd01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:54.277543 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-b8ec164f-f030-4b90-bf94-454c1607bd01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:54.283599 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b8ec164f-f030-4b90-bf94-454c1607bd01 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1663 microversion: 2.1 time: 0.150969 Jun 27 15:11:54.284236 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1210/1460] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:54 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:54.828938 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e1c29c6b-0221-46c4-92af-9bb7c3c5a21d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:54.829600 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-e1c29c6b-0221-46c4-92af-9bb7c3c5a21d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:54.835362 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1c29c6b-0221-46c4-92af-9bb7c3c5a21d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:54.837962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1c29c6b-0221-46c4-92af-9bb7c3c5a21d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:54.837962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1c29c6b-0221-46c4-92af-9bb7c3c5a21d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:54.837962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-e1c29c6b-0221-46c4-92af-9bb7c3c5a21d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:54.968855 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-e1c29c6b-0221-46c4-92af-9bb7c3c5a21d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:54.976335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e1c29c6b-0221-46c4-92af-9bb7c3c5a21d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1453 microversion: 2.1 time: 0.151543 Jun 27 15:11:54.976952 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1211/1461] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:54 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:54.992190 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-96fa5888-a198-4dbd-9e57-f4dba7abf80d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:54.992834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-96fa5888-a198-4dbd-9e57-f4dba7abf80d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:54.998531 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96fa5888-a198-4dbd-9e57-f4dba7abf80d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:54.998980 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96fa5888-a198-4dbd-9e57-f4dba7abf80d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:54.999748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96fa5888-a198-4dbd-9e57-f4dba7abf80d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:55.000165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-96fa5888-a198-4dbd-9e57-f4dba7abf80d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:55.129385 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-96fa5888-a198-4dbd-9e57-f4dba7abf80d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:55.136874 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-96fa5888-a198-4dbd-9e57-f4dba7abf80d tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1453 microversion: 2.1 time: 0.148076 Jun 27 15:11:55.137758 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1212/1462] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:54 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:55.304422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-c1b67261-0931-4793-9bb7-f9d65c569c34 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:55.305053 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-c1b67261-0931-4793-9bb7-f9d65c569c34 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:55.311523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1b67261-0931-4793-9bb7-f9d65c569c34 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:55.311967 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1b67261-0931-4793-9bb7-f9d65c569c34 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:55.312739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1b67261-0931-4793-9bb7-f9d65c569c34 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:55.313167 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-c1b67261-0931-4793-9bb7-f9d65c569c34 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:55.559173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-c1b67261-0931-4793-9bb7-f9d65c569c34 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:55.567039 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-c1b67261-0931-4793-9bb7-f9d65c569c34 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1663 microversion: 2.1 time: 0.266373 Jun 27 15:11:55.567627 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1213/1463] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:55 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1663 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:56.585080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a72daa43-7e5b-4b1e-a604-1e69c451f6f3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:11:56.585732 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a72daa43-7e5b-4b1e-a604-1e69c451f6f3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:11:56.589437 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:56.593557 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a72daa43-7e5b-4b1e-a604-1e69c451f6f3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:56.593995 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a72daa43-7e5b-4b1e-a604-1e69c451f6f3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:56.594806 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a72daa43-7e5b-4b1e-a604-1e69c451f6f3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:56.595232 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a72daa43-7e5b-4b1e-a604-1e69c451f6f3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:56.893942 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-a72daa43-7e5b-4b1e-a604-1e69c451f6f3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:11:56.903491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a72daa43-7e5b-4b1e-a604-1e69c451f6f3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1667 microversion: 2.1 time: 0.320863 Jun 27 15:11:56.903491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1214/1464] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:11:56 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1667 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:11:57.647347 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-aa968cf5-05ba-4a3d-af25-dc0dc229e307 req-3f2fef9c-8186-41e7-8d21-9597393cf5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9b72b3-b17b-4750-b7d7-0ff8cfb748be", "tag": "fa16b275-b3c0-487a-9c0c-7c682ebcc923"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:11:57.656393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-aa968cf5-05ba-4a3d-af25-dc0dc229e307 req-3f2fef9c-8186-41e7-8d21-9597393cf5d2 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:11:57.656880 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-aa968cf5-05ba-4a3d-af25-dc0dc229e307 req-3f2fef9c-8186-41e7-8d21-9597393cf5d2 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:11:57.667463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-aa968cf5-05ba-4a3d-af25-dc0dc229e307 req-3f2fef9c-8186-41e7-8d21-9597393cf5d2 service nova] Creating event network-changed:fa16b275-b3c0-487a-9c0c-7c682ebcc923 for instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be on hv-cinder-79760 Jun 27 15:11:57.673088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-aa968cf5-05ba-4a3d-af25-dc0dc229e307 req-3f2fef9c-8186-41e7-8d21-9597393cf5d2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029361 Jun 27 15:11:57.674219 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1215/1465] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:13:05.294525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:05.295265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:05.299727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-05d8e75c-7f71-4781-9793-50abd9e4985d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:05.315800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-05d8e75c-7f71-4781-9793-50abd9e4985d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:05.315800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05d8e75c-7f71-4781-9793-50abd9e4985d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:05.315800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05d8e75c-7f71-4781-9793-50abd9e4985d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:05.315800 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05d8e75c-7f71-4781-9793-50abd9e4985d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:05.316182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-05d8e75c-7f71-4781-9793-50abd9e4985d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:05.337047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-05d8e75c-7f71-4781-9793-50abd9e4985d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044589 Jun 27 15:13:05.337584 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1216/1466] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:13:05 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:13:05.394173 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-19b97b88-d164-4191-ae7a-953906b0eea0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:05.394663 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-19b97b88-d164-4191-ae7a-953906b0eea0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:05.402141 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19b97b88-d164-4191-ae7a-953906b0eea0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:05.402579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19b97b88-d164-4191-ae7a-953906b0eea0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:05.403318 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19b97b88-d164-4191-ae7a-953906b0eea0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:05.403770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-19b97b88-d164-4191-ae7a-953906b0eea0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:05.429182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-19b97b88-d164-4191-ae7a-953906b0eea0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:13:05.684897 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-19b97b88-d164-4191-ae7a-953906b0eea0 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "DELETE /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 204 len: 0 microversion: 2.1 time: 0.294194 Jun 27 15:13:05.685481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1217/1467] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:13:05 2022] DELETE /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:13:05.694861 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1079c62e-f55e-4135-a41e-aff9f82e5c71 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:05.696772 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1079c62e-f55e-4135-a41e-aff9f82e5c71 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:05.701591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1079c62e-f55e-4135-a41e-aff9f82e5c71 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:05.702027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1079c62e-f55e-4135-a41e-aff9f82e5c71 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:05.702778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1079c62e-f55e-4135-a41e-aff9f82e5c71 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:05.703203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1079c62e-f55e-4135-a41e-aff9f82e5c71 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:05.837669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1079c62e-f55e-4135-a41e-aff9f82e5c71 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:05.845170 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1079c62e-f55e-4135-a41e-aff9f82e5c71 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1673 microversion: 2.1 time: 0.155322 Jun 27 15:13:05.845729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1218/1468] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:05 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:06.862632 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0812de3a-26ac-4ad8-ac6a-1360b634ca44 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:06.863365 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0812de3a-26ac-4ad8-ac6a-1360b634ca44 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:06.870271 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0812de3a-26ac-4ad8-ac6a-1360b634ca44 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:06.870711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0812de3a-26ac-4ad8-ac6a-1360b634ca44 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:06.871446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0812de3a-26ac-4ad8-ac6a-1360b634ca44 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:06.871872 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0812de3a-26ac-4ad8-ac6a-1360b634ca44 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:06.998579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0812de3a-26ac-4ad8-ac6a-1360b634ca44 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:07.006788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0812de3a-26ac-4ad8-ac6a-1360b634ca44 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1673 microversion: 2.1 time: 0.147996 Jun 27 15:13:07.007342 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1219/1469] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:06 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:08.023804 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8630853e-016d-4257-bebb-34c1920e32d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:08.024525 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8630853e-016d-4257-bebb-34c1920e32d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:08.030834 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8630853e-016d-4257-bebb-34c1920e32d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:08.031282 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8630853e-016d-4257-bebb-34c1920e32d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:08.032028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8630853e-016d-4257-bebb-34c1920e32d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:08.032460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8630853e-016d-4257-bebb-34c1920e32d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:08.263609 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8630853e-016d-4257-bebb-34c1920e32d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:08.271077 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8630853e-016d-4257-bebb-34c1920e32d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1673 microversion: 2.1 time: 0.251647 Jun 27 15:13:08.271644 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1220/1470] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:08 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:09.048280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-9ef322d1-c2e3-4e94-846f-eab7c58a0426 req-c1c897ce-a53a-452e-9695-fed1385553af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9fd2bf-be40-498e-94d5-8ea8e588bcba", "name": "network-vif-deleted", "tag": "dda4dc60-e343-47ed-97db-a6e302c3885c"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:13:09.057163 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-9ef322d1-c2e3-4e94-846f-eab7c58a0426 req-c1c897ce-a53a-452e-9695-fed1385553af service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:09.057604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-9ef322d1-c2e3-4e94-846f-eab7c58a0426 req-c1c897ce-a53a-452e-9695-fed1385553af service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:09.068864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-9ef322d1-c2e3-4e94-846f-eab7c58a0426 req-c1c897ce-a53a-452e-9695-fed1385553af service nova] Creating event network-vif-deleted:dda4dc60-e343-47ed-97db-a6e302c3885c for instance da9fd2bf-be40-498e-94d5-8ea8e588bcba on hv-cinder-79760 Jun 27 15:13:09.074050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-9ef322d1-c2e3-4e94-846f-eab7c58a0426 req-c1c897ce-a53a-452e-9695-fed1385553af service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029400 Jun 27 15:13:09.074830 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1221/1471] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:13:09.289214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f1631a0d-bb07-4c79-9f0a-93dbbba871fe tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:09.290042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f1631a0d-bb07-4c79-9f0a-93dbbba871fe tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:09.296380 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f1631a0d-bb07-4c79-9f0a-93dbbba871fe tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:09.296938 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f1631a0d-bb07-4c79-9f0a-93dbbba871fe tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:09.297962 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f1631a0d-bb07-4c79-9f0a-93dbbba871fe tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:09.298498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f1631a0d-bb07-4c79-9f0a-93dbbba871fe tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:09.366214 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-f1631a0d-bb07-4c79-9f0a-93dbbba871fe tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:09.373711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f1631a0d-bb07-4c79-9f0a-93dbbba871fe tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 200 len: 1323 microversion: 2.1 time: 0.090028 Jun 27 15:13:09.374274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1222/1472] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:09 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:10.391193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:10.391845 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:10.398552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:10.398984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:10.399720 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:10.400146 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:10.416042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] HTTP exception thrown: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Request method failure captured: Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba HTTP/1.1 Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfdqZgZmXwYEFGoAIl8TguKRYlVreSElWffRvBtxZyRQpAiLPXNqSWYQJKY_BxDAGh9rC8SpxGLRaETZLfKzTHFh3B68L1tG8ydxa4c5bxY7h1yiUkkBcxYoEf4dCBMdO8_26d2ht7BRr7OrkqKN1g2AZsnfxvRHV8yn4zeW01Z4Zk Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:13:10.418237 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 093402db51104953a681418b958b2c38 Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:13:10.420078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'da9fd2bf-be40-498e-94d5-8ea8e588bcba'} Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:13:10.421106 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:13:10.422554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:10.424188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Returning 404 to user: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:13:10.424188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-89f24753-26d3-45d0-940e-771bae8a36e8 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 404 len: 111 microversion: 2.1 time: 0.032347 Jun 27 15:13:10.424188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1223/1473] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:10 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:13:10.428093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a0848a54-8728-4d09-8382-806ba03bc881 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '.version_select at 0x7f13f95d0160>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:10.515999 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a0848a54-8728-4d09-8382-806ba03bc881 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309445081" status: 202 len: 0 microversion: 2.1 time: 0.091280 Jun 27 15:13:10.516556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1224/1474] 10.222.0.44 () {58 vars in 1220 bytes} [Mon Jun 27 15:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309445081 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:13:11.256457 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0a34e532-92aa-4aa4-9065-c058001abcd7 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'create', calling method: .version_select at 0x7f13f9492d30>, body: {"keypair": {"name": "tempest-keypair-1814274164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNFtvB85aFiMNFaxkP1u1eSClnHouPf6ikhdxUJ3U+lWrp7xJeBblYtwBaU2RyuCGUem7jBYlKtnHIYCECgwpmfgrgjzxhVLlbMWgkaDJ47lfEWACIgFR27A49a9CIjfw=="}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:13:11.271767 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-0a34e532-92aa-4aa4-9065-c058001abcd7 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Getting quotas for project fa77b298448a40bbb2f12e1b5b9c5967. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:13:11.275735 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-0a34e532-92aa-4aa4-9065-c058001abcd7 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Getting quotas for user 093402db51104953a681418b958b2c38 and project fa77b298448a40bbb2f12e1b5b9c5967. Resources: {'key_pairs'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:13:11.344770 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0a34e532-92aa-4aa4-9065-c058001abcd7 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092221 Jun 27 15:13:11.345444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1225/1475] 10.222.0.44 () {60 vars in 1158 bytes} [Mon Jun 27 15:13:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:13:13.486898 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-775792380", "imageRef": "0f59e3ac-46ce-4419-b364-d52af6daf1c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33d44254-c39d-4ab7-9385-1f3e9a2d0259"}], "security_groups": [{"name": "tempest-securitygroup--1735363633"}], "key_name": "tempest-keypair-1814274164", "user_data": "}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:13:13.589392 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.network.neutron [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] validate_networks() for [('33d44254-c39d-4ab7-9385-1f3e9a2d0259', None, None, None, None, None)] {{(pid=129687) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:13:13.950631 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Flavor limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:13:13.951047 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Image limits 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:13:13.951507 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Flavor pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:13:13.951934 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Image pref 0:0:0 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:13:13.952333 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.virt.hardware [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129687) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:13:13.961739 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:13.962176 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:13.962947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:13.963373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:13.979810 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Getting quotas for project fa77b298448a40bbb2f12e1b5b9c5967. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:13:13.983649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.quota [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Getting quotas for user 093402db51104953a681418b958b2c38 and project fa77b298448a40bbb2f12e1b5b9c5967. Resources: {'instances', 'ram', 'cores'} {{(pid=129687) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:13:13.994406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Going to run 1 instances... {{(pid=129687) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:13:13.996598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f59e3ac-46ce-4419-b364-d52af6daf1c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129687) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:13:14.128313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-322ce4bc-e85a-4edd-b168-1d63cbde1e56 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.646071 Jun 27 15:13:14.129005 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1226/1476] 10.222.0.44 () {60 vars in 1146 bytes} [Mon Jun 27 15:13:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:13:14.196983 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1e4b98fa-414e-47d4-a7e9-53c1405bd6c1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:14.197639 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1e4b98fa-414e-47d4-a7e9-53c1405bd6c1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:14.253925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1e4b98fa-414e-47d4-a7e9-53c1405bd6c1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:14.262473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1e4b98fa-414e-47d4-a7e9-53c1405bd6c1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1237 microversion: 2.1 time: 0.126833 Jun 27 15:13:14.263066 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1227/1477] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:14 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1237 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:15.279295 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-1a36a89c-35f1-4ed5-994c-f0ca1e81536f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:15.279896 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-1a36a89c-35f1-4ed5-994c-f0ca1e81536f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:15.286468 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a36a89c-35f1-4ed5-994c-f0ca1e81536f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:15.290582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a36a89c-35f1-4ed5-994c-f0ca1e81536f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:15.290582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a36a89c-35f1-4ed5-994c-f0ca1e81536f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:15.290582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-1a36a89c-35f1-4ed5-994c-f0ca1e81536f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:15.353349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-1a36a89c-35f1-4ed5-994c-f0ca1e81536f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:15.360841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-1a36a89c-35f1-4ed5-994c-f0ca1e81536f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1241 microversion: 2.1 time: 0.085510 Jun 27 15:13:15.361617 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1228/1478] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:15 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:16.377816 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9f4f846d-8337-4ef0-924c-0d3f1ae9fc42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:16.378511 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9f4f846d-8337-4ef0-924c-0d3f1ae9fc42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:16.385555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f4f846d-8337-4ef0-924c-0d3f1ae9fc42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:16.386007 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f4f846d-8337-4ef0-924c-0d3f1ae9fc42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:16.386760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f4f846d-8337-4ef0-924c-0d3f1ae9fc42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:16.387193 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9f4f846d-8337-4ef0-924c-0d3f1ae9fc42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:16.452086 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9f4f846d-8337-4ef0-924c-0d3f1ae9fc42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:16.460080 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9f4f846d-8337-4ef0-924c-0d3f1ae9fc42 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1307 microversion: 2.1 time: 0.086162 Jun 27 15:13:16.460752 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1229/1479] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:16 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1307 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:17.477583 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-43f58205-767f-4655-b10c-f6e596b70fa6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:17.478292 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-43f58205-767f-4655-b10c-f6e596b70fa6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:17.484818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-43f58205-767f-4655-b10c-f6e596b70fa6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:17.485445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-43f58205-767f-4655-b10c-f6e596b70fa6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:17.486017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-43f58205-767f-4655-b10c-f6e596b70fa6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:17.486466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-43f58205-767f-4655-b10c-f6e596b70fa6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:17.710935 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-43f58205-767f-4655-b10c-f6e596b70fa6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:17.718595 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-43f58205-767f-4655-b10c-f6e596b70fa6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1363 microversion: 2.1 time: 0.245331 Jun 27 15:13:17.719260 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1230/1480] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:17 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:17.934174 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-525d97bd-fb83-4dd3-a5b1-2db923e3eeff req-99829413-ee5b-4d8f-99a1-b7ce534c12fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98e00d5-16fa-43aa-a5cb-083e8040bef9", "tag": "849c1c5d-922b-48ae-9d12-b1e316f69d97"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:13:17.943798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-525d97bd-fb83-4dd3-a5b1-2db923e3eeff req-99829413-ee5b-4d8f-99a1-b7ce534c12fc service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:17.944446 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-525d97bd-fb83-4dd3-a5b1-2db923e3eeff req-99829413-ee5b-4d8f-99a1-b7ce534c12fc service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:17.965463 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-525d97bd-fb83-4dd3-a5b1-2db923e3eeff req-99829413-ee5b-4d8f-99a1-b7ce534c12fc service nova] Creating event network-changed:849c1c5d-922b-48ae-9d12-b1e316f69d97 for instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 on hv-cinder-79760 Jun 27 15:13:17.970514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-525d97bd-fb83-4dd3-a5b1-2db923e3eeff req-99829413-ee5b-4d8f-99a1-b7ce534c12fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040559 Jun 27 15:13:17.971112 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1231/1481] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:13:18.737477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-43fbe7ad-d2f5-47c2-afb2-f20d0d6a1d82 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:18.738122 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-43fbe7ad-d2f5-47c2-afb2-f20d0d6a1d82 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:18.749879 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-43fbe7ad-d2f5-47c2-afb2-f20d0d6a1d82 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:18.750351 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-43fbe7ad-d2f5-47c2-afb2-f20d0d6a1d82 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:18.751211 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-43fbe7ad-d2f5-47c2-afb2-f20d0d6a1d82 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:18.751640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-43fbe7ad-d2f5-47c2-afb2-f20d0d6a1d82 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:18.884241 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-43fbe7ad-d2f5-47c2-afb2-f20d0d6a1d82 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:18.891504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-43fbe7ad-d2f5-47c2-afb2-f20d0d6a1d82 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1363 microversion: 2.1 time: 0.158579 Jun 27 15:13:18.892065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1232/1482] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:18 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:19.908661 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4ae9f9f6-c09f-47c9-a5a7-16270fc31eee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:19.909377 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-4ae9f9f6-c09f-47c9-a5a7-16270fc31eee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:19.915837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ae9f9f6-c09f-47c9-a5a7-16270fc31eee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:19.916285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ae9f9f6-c09f-47c9-a5a7-16270fc31eee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:19.917075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ae9f9f6-c09f-47c9-a5a7-16270fc31eee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:19.917509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-4ae9f9f6-c09f-47c9-a5a7-16270fc31eee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:20.044460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-4ae9f9f6-c09f-47c9-a5a7-16270fc31eee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:20.052495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4ae9f9f6-c09f-47c9-a5a7-16270fc31eee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1363 microversion: 2.1 time: 0.147809 Jun 27 15:13:20.053590 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1233/1483] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:19 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:21.070526 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5ccca2d3-7e60-40d6-9b8d-9b90216e049a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:21.071249 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5ccca2d3-7e60-40d6-9b8d-9b90216e049a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:21.077614 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ccca2d3-7e60-40d6-9b8d-9b90216e049a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:21.078057 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ccca2d3-7e60-40d6-9b8d-9b90216e049a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:21.078798 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ccca2d3-7e60-40d6-9b8d-9b90216e049a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:21.079221 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5ccca2d3-7e60-40d6-9b8d-9b90216e049a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:21.212445 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5ccca2d3-7e60-40d6-9b8d-9b90216e049a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:21.219805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5ccca2d3-7e60-40d6-9b8d-9b90216e049a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1363 microversion: 2.1 time: 0.153702 Jun 27 15:13:21.220564 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1234/1484] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:21 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:22.236654 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5070b203-99e9-4657-8c29-bea86acbd6e3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:22.237321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5070b203-99e9-4657-8c29-bea86acbd6e3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:22.243488 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5070b203-99e9-4657-8c29-bea86acbd6e3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:22.243955 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5070b203-99e9-4657-8c29-bea86acbd6e3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:22.244719 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5070b203-99e9-4657-8c29-bea86acbd6e3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:22.245147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5070b203-99e9-4657-8c29-bea86acbd6e3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:22.377310 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-5070b203-99e9-4657-8c29-bea86acbd6e3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:22.384563 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5070b203-99e9-4657-8c29-bea86acbd6e3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1363 microversion: 2.1 time: 0.151701 Jun 27 15:13:22.385132 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1235/1485] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:22 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:23.401492 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7f5d21f5-d90b-4d6d-9154-8e2fc12fbbf2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:23.402144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7f5d21f5-d90b-4d6d-9154-8e2fc12fbbf2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:23.408495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7f5d21f5-d90b-4d6d-9154-8e2fc12fbbf2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:23.408989 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7f5d21f5-d90b-4d6d-9154-8e2fc12fbbf2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:23.409730 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7f5d21f5-d90b-4d6d-9154-8e2fc12fbbf2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:23.410157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7f5d21f5-d90b-4d6d-9154-8e2fc12fbbf2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:23.429353 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:23.540690 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7f5d21f5-d90b-4d6d-9154-8e2fc12fbbf2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:23.547715 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7f5d21f5-d90b-4d6d-9154-8e2fc12fbbf2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1363 microversion: 2.1 time: 0.150081 Jun 27 15:13:23.548274 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1236/1486] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:23 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:24.111374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-ae7fc479-c400-45fa-83d1-26a1a72db798 req-8839cabc-1d17-45d8-aed1-2cc80df3c43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98e00d5-16fa-43aa-a5cb-083e8040bef9", "name": "network-vif-plugged", "status": "completed", "tag": "849c1c5d-922b-48ae-9d12-b1e316f69d97"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:13:24.114794 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:24.121111 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-ae7fc479-c400-45fa-83d1-26a1a72db798 req-8839cabc-1d17-45d8-aed1-2cc80df3c43c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:24.121552 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-ae7fc479-c400-45fa-83d1-26a1a72db798 req-8839cabc-1d17-45d8-aed1-2cc80df3c43c service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:24.132144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-ae7fc479-c400-45fa-83d1-26a1a72db798 req-8839cabc-1d17-45d8-aed1-2cc80df3c43c service nova] Creating event network-vif-plugged:849c1c5d-922b-48ae-9d12-b1e316f69d97 for instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 on hv-cinder-79760 Jun 27 15:13:24.140316 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-ae7fc479-c400-45fa-83d1-26a1a72db798 req-8839cabc-1d17-45d8-aed1-2cc80df3c43c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030972 Jun 27 15:13:24.140316 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1237/1487] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:13:24.562508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell0:SELECT=12 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:24.567371 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-84fbfc43-2525-4471-bc45-cd522e0618d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:24.568054 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-84fbfc43-2525-4471-bc45-cd522e0618d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:24.574297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-84fbfc43-2525-4471-bc45-cd522e0618d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:24.574740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-84fbfc43-2525-4471-bc45-cd522e0618d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:24.575569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-84fbfc43-2525-4471-bc45-cd522e0618d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:24.576000 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-84fbfc43-2525-4471-bc45-cd522e0618d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:24.703622 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-84fbfc43-2525-4471-bc45-cd522e0618d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:24.712145 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-84fbfc43-2525-4471-bc45-cd522e0618d6 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1363 microversion: 2.1 time: 0.150450 Jun 27 15:13:24.712877 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1238/1488] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:24 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:25.729495 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-0f3a3ca1-cb9f-49d3-9aae-2ca2733d0a6a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:25.730261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-0f3a3ca1-cb9f-49d3-9aae-2ca2733d0a6a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:25.736556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f3a3ca1-cb9f-49d3-9aae-2ca2733d0a6a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:25.737027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f3a3ca1-cb9f-49d3-9aae-2ca2733d0a6a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:25.737776 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f3a3ca1-cb9f-49d3-9aae-2ca2733d0a6a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:25.738206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-0f3a3ca1-cb9f-49d3-9aae-2ca2733d0a6a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:25.869529 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-0f3a3ca1-cb9f-49d3-9aae-2ca2733d0a6a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:25.876789 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-0f3a3ca1-cb9f-49d3-9aae-2ca2733d0a6a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1363 microversion: 2.1 time: 0.151649 Jun 27 15:13:25.877349 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1239/1489] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:25 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:26.893604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cfd6b2a0-92cf-404b-9c44-0887cf4674f9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:26.899108 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cfd6b2a0-92cf-404b-9c44-0887cf4674f9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:26.901207 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfd6b2a0-92cf-404b-9c44-0887cf4674f9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:26.901654 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfd6b2a0-92cf-404b-9c44-0887cf4674f9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:26.902404 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfd6b2a0-92cf-404b-9c44-0887cf4674f9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:26.902832 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfd6b2a0-92cf-404b-9c44-0887cf4674f9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:27.030114 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cfd6b2a0-92cf-404b-9c44-0887cf4674f9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:27.038023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cfd6b2a0-92cf-404b-9c44-0887cf4674f9 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1548 microversion: 2.1 time: 0.147748 Jun 27 15:13:27.038597 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1240/1490] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:26 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:27.054684 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5d7b4e8d-a5ef-4a21-8663-9dc3cf5bf50d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:27.055222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5d7b4e8d-a5ef-4a21-8663-9dc3cf5bf50d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:27.060982 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d7b4e8d-a5ef-4a21-8663-9dc3cf5bf50d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:27.061474 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d7b4e8d-a5ef-4a21-8663-9dc3cf5bf50d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:27.062256 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d7b4e8d-a5ef-4a21-8663-9dc3cf5bf50d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:27.062685 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5d7b4e8d-a5ef-4a21-8663-9dc3cf5bf50d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:27.138229 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5d7b4e8d-a5ef-4a21-8663-9dc3cf5bf50d tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087890 Jun 27 15:13:27.138824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1241/1491] 10.222.0.44 () {58 vars in 1274 bytes} [Mon Jun 27 15:13:27 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:13:28.362026 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-4826912d-cf2c-4c4e-84b7-8563abb058e4 req-0eab01e4-a908-4fd6-b304-15ddd4209527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98e00d5-16fa-43aa-a5cb-083e8040bef9", "tag": "849c1c5d-922b-48ae-9d12-b1e316f69d97"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:13:28.370577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-4826912d-cf2c-4c4e-84b7-8563abb058e4 req-0eab01e4-a908-4fd6-b304-15ddd4209527 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:28.371022 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-4826912d-cf2c-4c4e-84b7-8563abb058e4 req-0eab01e4-a908-4fd6-b304-15ddd4209527 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:28.384883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-4826912d-cf2c-4c4e-84b7-8563abb058e4 req-0eab01e4-a908-4fd6-b304-15ddd4209527 service nova] Creating event network-changed:849c1c5d-922b-48ae-9d12-b1e316f69d97 for instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 on hv-cinder-79760 Jun 27 15:13:28.389864 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-4826912d-cf2c-4c4e-84b7-8563abb058e4 req-0eab01e4-a908-4fd6-b304-15ddd4209527 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031840 Jun 27 15:13:28.390671 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1242/1492] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:13:49.066075 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-af493248-1c3b-4de9-814b-ab2bd0caf353 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:49.066737 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-af493248-1c3b-4de9-814b-ab2bd0caf353 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:49.069428 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:49.070088 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=28 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:49.079918 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af493248-1c3b-4de9-814b-ab2bd0caf353 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:49.080381 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af493248-1c3b-4de9-814b-ab2bd0caf353 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:49.081155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af493248-1c3b-4de9-814b-ab2bd0caf353 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:49.081582 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-af493248-1c3b-4de9-814b-ab2bd0caf353 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:49.111448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-af493248-1c3b-4de9-814b-ab2bd0caf353 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:13:49.405429 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-af493248-1c3b-4de9-814b-ab2bd0caf353 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 204 len: 0 microversion: 2.1 time: 0.343106 Jun 27 15:13:49.406155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1243/1493] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:13:49 2022] DELETE /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:13:49.470472 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-d3f23f8d-c95a-4ff5-bc31-2d6cdd6608cb req-2d1a3411-c6b7-4692-9d64-fd3706a6d696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9b72b3-b17b-4750-b7d7-0ff8cfb748be", "tag": "fa16b275-b3c0-487a-9c0c-7c682ebcc923"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:13:49.479148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-d3f23f8d-c95a-4ff5-bc31-2d6cdd6608cb req-2d1a3411-c6b7-4692-9d64-fd3706a6d696 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:49.479589 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-d3f23f8d-c95a-4ff5-bc31-2d6cdd6608cb req-2d1a3411-c6b7-4692-9d64-fd3706a6d696 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:49.493151 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-d3f23f8d-c95a-4ff5-bc31-2d6cdd6608cb req-2d1a3411-c6b7-4692-9d64-fd3706a6d696 service nova] Creating event network-changed:fa16b275-b3c0-487a-9c0c-7c682ebcc923 for instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be on hv-cinder-79760 Jun 27 15:13:49.499055 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-d3f23f8d-c95a-4ff5-bc31-2d6cdd6608cb req-2d1a3411-c6b7-4692-9d64-fd3706a6d696 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090741 Jun 27 15:13:49.499959 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1244/1494] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:13:49.505212 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-21c967a2-8bac-439b-b0a2-6fe4af0e3b49 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:49.505909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-21c967a2-8bac-439b-b0a2-6fe4af0e3b49 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:49.512601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-21c967a2-8bac-439b-b0a2-6fe4af0e3b49 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:49.513111 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-21c967a2-8bac-439b-b0a2-6fe4af0e3b49 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:49.513907 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-21c967a2-8bac-439b-b0a2-6fe4af0e3b49 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:49.514378 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-21c967a2-8bac-439b-b0a2-6fe4af0e3b49 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:49.649693 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-21c967a2-8bac-439b-b0a2-6fe4af0e3b49 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:49.657276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-21c967a2-8bac-439b-b0a2-6fe4af0e3b49 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1577 microversion: 2.1 time: 0.156106 Jun 27 15:13:49.657857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1245/1495] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:49 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:13:50.674724 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-56c173a6-7d56-47c6-a54b-44f4f344a283 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:50.675421 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-56c173a6-7d56-47c6-a54b-44f4f344a283 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:50.681705 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-56c173a6-7d56-47c6-a54b-44f4f344a283 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:50.682153 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-56c173a6-7d56-47c6-a54b-44f4f344a283 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:50.682908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-56c173a6-7d56-47c6-a54b-44f4f344a283 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:50.683341 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-56c173a6-7d56-47c6-a54b-44f4f344a283 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:50.837374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-56c173a6-7d56-47c6-a54b-44f4f344a283 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:50.844823 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-56c173a6-7d56-47c6-a54b-44f4f344a283 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1577 microversion: 2.1 time: 0.174207 Jun 27 15:13:50.845387 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1246/1496] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:50 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:51.863169 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-08df8a02-684f-4e8f-be11-71b2f923f0d0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:51.863900 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-08df8a02-684f-4e8f-be11-71b2f923f0d0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:51.869805 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08df8a02-684f-4e8f-be11-71b2f923f0d0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:51.870251 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08df8a02-684f-4e8f-be11-71b2f923f0d0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:51.870994 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08df8a02-684f-4e8f-be11-71b2f923f0d0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:51.871427 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-08df8a02-684f-4e8f-be11-71b2f923f0d0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:51.963123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-08df8a02-684f-4e8f-be11-71b2f923f0d0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:51.972517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-08df8a02-684f-4e8f-be11-71b2f923f0d0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1391 microversion: 2.1 time: 0.113209 Jun 27 15:13:51.976094 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1247/1497] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:51 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1391 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:52.017322 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-65ef3ca7-e545-4a93-b74b-bebb756fa1d8 req-3ee27830-14e4-4549-8ab8-2c91eb418bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9b72b3-b17b-4750-b7d7-0ff8cfb748be", "name": "network-vif-deleted", "tag": "fa16b275-b3c0-487a-9c0c-7c682ebcc923"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:13:52.025248 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-65ef3ca7-e545-4a93-b74b-bebb756fa1d8 req-3ee27830-14e4-4549-8ab8-2c91eb418bb1 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:52.028473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-65ef3ca7-e545-4a93-b74b-bebb756fa1d8 req-3ee27830-14e4-4549-8ab8-2c91eb418bb1 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:52.036745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-65ef3ca7-e545-4a93-b74b-bebb756fa1d8 req-3ee27830-14e4-4549-8ab8-2c91eb418bb1 service nova] Creating event network-vif-deleted:fa16b275-b3c0-487a-9c0c-7c682ebcc923 for instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be on hv-cinder-79760 Jun 27 15:13:52.041449 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-65ef3ca7-e545-4a93-b74b-bebb756fa1d8 req-3ee27830-14e4-4549-8ab8-2c91eb418bb1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028517 Jun 27 15:13:52.045701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1248/1498] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:13:52.990848 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:52.991550 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:52.997706 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:52.998183 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:52.998956 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:52.999384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:53.028775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:53.029746 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:53.030215 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lazy-loading 'fault' on Instance uuid 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:13:53.074837 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:53.083919 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-8042d85d-c45c-4bbf-b0ed-6b124f591914 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 200 len: 1230 microversion: 2.1 time: 0.097805 Jun 27 15:13:53.084477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1249/1499] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:52 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:13:54.101887 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:54.102565 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:54.110554 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:54.111004 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:54.111768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:54.112203 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:54.128194 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] HTTP exception thrown: Instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be could not be found. Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Request method failure captured: Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be HTTP/1.1 Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiuccxYZZsDfqlqbCH7qt_1Yv0161267ZZS4sQ1Mh-8yrm-FEOQAV6rf4MXiMAX6szq7di_fCk69J_C0tjWzqVvSEFIyQnZ3zqH2Hz7RrBfQKbvyzwGHhX5yRX3qI7UqHvEIwGq9biNtCZD3cvoRQa5GBLLmG2ONU74O31hb2xMTjr4-I Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:13:54.129873 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-TestVolumeBootPattern-738308969 Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: e6357e83df904ea09221cfc374d776c4 Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be could not be found. Jun 27 15:13:54.131422 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '6f9b72b3-b17b-4750-b7d7-0ff8cfb748be'} Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be could not be found. Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:13:54.132452 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be could not be found. Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be could not be found. Jun 27 15:13:54.134265 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:13:54.136062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Returning 404 to user: Instance 6f9b72b3-b17b-4750-b7d7-0ff8cfb748be could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:13:54.136062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-027a3988-9b78-42f9-8f8c-1dcfea3292de tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be" status: 404 len: 111 microversion: 2.1 time: 0.033225 Jun 27 15:13:54.136062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1250/1500] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:54 2022] GET /compute/v2.1/servers/6f9b72b3-b17b-4750-b7d7-0ff8cfb748be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:13:57.658624 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9ac2de64-c6b5-46b3-bf0e-335bdd87ecc0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:57.659222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9ac2de64-c6b5-46b3-bf0e-335bdd87ecc0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:57.665558 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ac2de64-c6b5-46b3-bf0e-335bdd87ecc0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:57.670299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ac2de64-c6b5-46b3-bf0e-335bdd87ecc0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:57.670299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ac2de64-c6b5-46b3-bf0e-335bdd87ecc0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:57.670299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9ac2de64-c6b5-46b3-bf0e-335bdd87ecc0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:57.694571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9ac2de64-c6b5-46b3-bf0e-335bdd87ecc0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:13:57.983950 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9ac2de64-c6b5-46b3-bf0e-335bdd87ecc0 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "DELETE /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 204 len: 0 microversion: 2.1 time: 0.328999 Jun 27 15:13:57.984745 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1251/1501] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:13:57 2022] DELETE /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:13:57.990447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-d28b5553-988d-4897-994b-b1280d6aa927 req-75028175-c72d-41cb-9a82-d1c78ca2c036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95dd20a9-56f2-45e8-918f-4be55af8daf5", "tag": "a9a30dca-ba32-42bd-87ab-d507a0394de8"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:13:57.999013 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-d28b5553-988d-4897-994b-b1280d6aa927 req-75028175-c72d-41cb-9a82-d1c78ca2c036 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:57.999442 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-d28b5553-988d-4897-994b-b1280d6aa927 req-75028175-c72d-41cb-9a82-d1c78ca2c036 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:58.011607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-d28b5553-988d-4897-994b-b1280d6aa927 req-75028175-c72d-41cb-9a82-d1c78ca2c036 service nova] Creating event network-changed:a9a30dca-ba32-42bd-87ab-d507a0394de8 for instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 on hv-cinder-79760 Jun 27 15:13:58.016906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-d28b5553-988d-4897-994b-b1280d6aa927 req-75028175-c72d-41cb-9a82-d1c78ca2c036 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030626 Jun 27 15:13:58.017560 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1252/1502] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:13:58.022538 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9e6923bf-cd05-41ca-af81-6665c5c91e4e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:58.023220 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9e6923bf-cd05-41ca-af81-6665c5c91e4e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:58.030844 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e6923bf-cd05-41ca-af81-6665c5c91e4e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:58.031291 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e6923bf-cd05-41ca-af81-6665c5c91e4e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:58.032040 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e6923bf-cd05-41ca-af81-6665c5c91e4e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:58.032465 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9e6923bf-cd05-41ca-af81-6665c5c91e4e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:58.169071 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-9e6923bf-cd05-41ca-af81-6665c5c91e4e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:58.177640 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9e6923bf-cd05-41ca-af81-6665c5c91e4e tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1578 microversion: 2.1 time: 0.158950 Jun 27 15:13:58.178649 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1253/1503] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:58 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:13:59.195321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fc50b55f-0dc6-4f56-a1da-fa79d24a350f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:13:59.196027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fc50b55f-0dc6-4f56-a1da-fa79d24a350f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:13:59.202533 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc50b55f-0dc6-4f56-a1da-fa79d24a350f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:59.202972 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc50b55f-0dc6-4f56-a1da-fa79d24a350f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:59.203723 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc50b55f-0dc6-4f56-a1da-fa79d24a350f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:13:59.204147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fc50b55f-0dc6-4f56-a1da-fa79d24a350f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:13:59.401666 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-fc50b55f-0dc6-4f56-a1da-fa79d24a350f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:13:59.409104 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fc50b55f-0dc6-4f56-a1da-fa79d24a350f tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1578 microversion: 2.1 time: 0.217655 Jun 27 15:13:59.409669 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1254/1504] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:13:59 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1578 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:14:00.426665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-46c40444-87ab-4f4b-a142-69595a9c646c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:14:00.427727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-46c40444-87ab-4f4b-a142-69595a9c646c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:00.433858 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46c40444-87ab-4f4b-a142-69595a9c646c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:00.434356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46c40444-87ab-4f4b-a142-69595a9c646c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:00.435103 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46c40444-87ab-4f4b-a142-69595a9c646c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:00.436250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-46c40444-87ab-4f4b-a142-69595a9c646c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:00.505480 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-46c40444-87ab-4f4b-a142-69595a9c646c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:14:00.513038 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-46c40444-87ab-4f4b-a142-69595a9c646c tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1392 microversion: 2.1 time: 0.091313 Jun 27 15:14:00.515003 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1255/1505] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:14:00 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1392 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:14:00.572686 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-2f6e7381-f319-4a1e-b190-26221663c524 req-6e56860e-7d38-4192-9033-62ba373fd658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95dd20a9-56f2-45e8-918f-4be55af8daf5", "name": "network-vif-deleted", "tag": "a9a30dca-ba32-42bd-87ab-d507a0394de8"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:14:00.581984 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-2f6e7381-f319-4a1e-b190-26221663c524 req-6e56860e-7d38-4192-9033-62ba373fd658 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:00.582425 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-2f6e7381-f319-4a1e-b190-26221663c524 req-6e56860e-7d38-4192-9033-62ba373fd658 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:00.594280 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-2f6e7381-f319-4a1e-b190-26221663c524 req-6e56860e-7d38-4192-9033-62ba373fd658 service nova] Creating event network-vif-deleted:a9a30dca-ba32-42bd-87ab-d507a0394de8 for instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 on hv-cinder-79760 Jun 27 15:14:00.599339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-2f6e7381-f319-4a1e-b190-26221663c524 req-6e56860e-7d38-4192-9033-62ba373fd658 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083753 Jun 27 15:14:00.599927 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1256/1506] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:14:01.532326 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:14:01.533050 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:01.539711 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:01.540603 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:01.540990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:01.541426 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:01.574477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:01.574986 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:01.575444 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lazy-loading 'fault' on Instance uuid 95dd20a9-56f2-45e8-918f-4be55af8daf5 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:14:01.619902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6357e83df904ea09221cfc374d776c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba2dfe000d427b9ab9dff2601436f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:14:01.627587 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-cfe36e5e-aebe-42f9-8dcc-df7b7b00cd64 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 200 len: 1231 microversion: 2.1 time: 0.100552 Jun 27 15:14:01.628157 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1257/1507] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:14:01 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:14:02.644403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:14:02.645205 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: 95dd20a9-56f2-45e8-918f-4be55af8daf5] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:02.651515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:02.651961 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:02.652747 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:02.653182 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:02.667604 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] HTTP exception thrown: Instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 could not be found. Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Request method failure captured: Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 HTTP/1.1 Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiuccxYZZsDfqlqbCH7qt_1Yv0161267ZZS4sQ1Mh-8yrm-FEOQAV6rf4MXiMAX6szq7di_fCk69J_C0tjWzqVvSEFIyQnZ3zqH2Hz7RrBfQKbvyzwGHhX5yRX3qI7UqHvEIwGq9biNtCZD3cvoRQa5GBLLmG2ONU74O31hb2xMTjr4-I Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:14:02.669255 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-TestVolumeBootPattern-738308969 Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: e6357e83df904ea09221cfc374d776c4 Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 could not be found. Jun 27 15:14:02.671607 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': '95dd20a9-56f2-45e8-918f-4be55af8daf5'} Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 could not be found. Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:14:02.673165 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 could not be found. Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 could not be found. Jun 27 15:14:02.674911 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:02.676540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Returning 404 to user: Instance 95dd20a9-56f2-45e8-918f-4be55af8daf5 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:14:02.676540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-a9b2f30e-1a01-438f-bdd8-c84e40a73717 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5" status: 404 len: 111 microversion: 2.1 time: 0.030735 Jun 27 15:14:02.676540 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1258/1508] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:14:02 2022] GET /compute/v2.1/servers/95dd20a9-56f2-45e8-918f-4be55af8daf5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:14:03.163990 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:14:03.164486 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:03.171056 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:03.171490 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:03.172235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:03.172680 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:03.186778 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] HTTP exception thrown: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Request method failure captured: Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 HTTP/1.1 Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiuccxYZZsDfqlqbCH7qt_1Yv0161267ZZS4sQ1Mh-8yrm-FEOQAV6rf4MXiMAX6szq7di_fCk69J_C0tjWzqVvSEFIyQnZ3zqH2Hz7RrBfQKbvyzwGHhX5yRX3qI7UqHvEIwGq9biNtCZD3cvoRQa5GBLLmG2ONU74O31hb2xMTjr4-I Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:14:03.188242 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-TestVolumeBootPattern-738308969 Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: e6357e83df904ea09221cfc374d776c4 Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.190090 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'a4300d49-751c-4048-bde6-5d4a1d940515'} Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:14:03.191231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.193001 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.194818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Returning 404 to user: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:14:03.194818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9c34d79e-7ec8-4e3c-a55e-bf16a7efffb2 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 404 len: 111 microversion: 2.1 time: 0.029486 Jun 27 15:14:03.194818 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1259/1509] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:14:03 2022] DELETE /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:14:03.197803 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:14:03.198391 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] [instance: a4300d49-751c-4048-bde6-5d4a1d940515] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:03.204308 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:03.204788 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:03.205523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:03.205947 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:03.209809 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:03.219243 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] HTTP exception thrown: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Request method failure captured: Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 HTTP/1.1 Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiuccxYZZsDfqlqbCH7qt_1Yv0161267ZZS4sQ1Mh-8yrm-FEOQAV6rf4MXiMAX6szq7di_fCk69J_C0tjWzqVvSEFIyQnZ3zqH2Hz7RrBfQKbvyzwGHhX5yRX3qI7UqHvEIwGq9biNtCZD3cvoRQa5GBLLmG2ONU74O31hb2xMTjr4-I Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:14:03.220755 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2bba2dfe000d427b9ab9dff2601436f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-TestVolumeBootPattern-738308969 Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: 2bba2dfe000d427b9ab9dff2601436f1 Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-TestVolumeBootPattern-738308969 Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: e6357e83df904ea09221cfc374d776c4 Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-TestVolumeBootPattern-738308969-project Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.222266 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'a4300d49-751c-4048-bde6-5d4a1d940515'} Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:14:03.223125 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. Jun 27 15:14:03.224695 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:14:03.226065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Returning 404 to user: Instance a4300d49-751c-4048-bde6-5d4a1d940515 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:14:03.226065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5a398d05-1a67-49fd-8ecf-207edc4aa284 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515" status: 404 len: 111 microversion: 2.1 time: 0.027776 Jun 27 15:14:03.226065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1260/1510] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:14:03 2022] GET /compute/v2.1/servers/a4300d49-751c-4048-bde6-5d4a1d940515 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:14:04.672319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6456f8af-d492-4193-9d1a-75e223ca8646 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] Calling method '.version_select at 0x7f13f94e3ca0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:14:04.765405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6456f8af-d492-4193-9d1a-75e223ca8646 tempest-TestVolumeBootPattern-738308969 tempest-TestVolumeBootPattern-738308969-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1387064064" status: 202 len: 0 microversion: 2.1 time: 0.097836 Jun 27 15:14:04.765979 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1261/1511] 10.222.0.44 () {58 vars in 1262 bytes} [Mon Jun 27 15:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1387064064 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:14:43.333017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:43.337335 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5f37f685-d275-41e4-a42d-585d4609eabc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:14:43.337829 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-5f37f685-d275-41e4-a42d-585d4609eabc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:43.345743 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f37f685-d275-41e4-a42d-585d4609eabc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:43.346200 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f37f685-d275-41e4-a42d-585d4609eabc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:43.346953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f37f685-d275-41e4-a42d-585d4609eabc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:43.347388 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-5f37f685-d275-41e4-a42d-585d4609eabc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:43.370359 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5f37f685-d275-41e4-a42d-585d4609eabc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/ips" status: 200 len: 145 microversion: 2.1 time: 0.039008 Jun 27 15:14:43.370951 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1262/1512] 10.222.0.44 () {58 vars in 1247 bytes} [Mon Jun 27 15:14:43 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:14:44.909668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3e3030d9-9a1c-4b03-be29-5672b4423539 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b21e865b-b2b2-42e0-a618-41a22918d284"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:14:44.911384 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3e3030d9-9a1c-4b03-be29-5672b4423539 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:44.918916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e3030d9-9a1c-4b03-be29-5672b4423539 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:44.922508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e3030d9-9a1c-4b03-be29-5672b4423539 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:44.922508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e3030d9-9a1c-4b03-be29-5672b4423539 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:44.922508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3e3030d9-9a1c-4b03-be29-5672b4423539 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:45.683523 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3e3030d9-9a1c-4b03-be29-5672b4423539 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778613 Jun 27 15:14:45.684130 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1263/1513] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:14:44 2022] POST /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:14:53.166477 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f17e6a3c-42d5-495e-91b8-df1e72d79161 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:14:53.167470 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f17e6a3c-42d5-495e-91b8-df1e72d79161 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:53.178277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f17e6a3c-42d5-495e-91b8-df1e72d79161 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:53.178277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f17e6a3c-42d5-495e-91b8-df1e72d79161 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:53.178277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f17e6a3c-42d5-495e-91b8-df1e72d79161 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:53.178277 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f17e6a3c-42d5-495e-91b8-df1e72d79161 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:53.207145 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f17e6a3c-42d5-495e-91b8-df1e72d79161 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Jun 27 15:14:53.207702 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1264/1514] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:14:53 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:14:53.223027 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b41d94b7-1b44-4b7d-bcae-24d21e53716f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:14:53.223515 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-b41d94b7-1b44-4b7d-bcae-24d21e53716f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:53.229252 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b41d94b7-1b44-4b7d-bcae-24d21e53716f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:53.229703 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b41d94b7-1b44-4b7d-bcae-24d21e53716f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:53.230448 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b41d94b7-1b44-4b7d-bcae-24d21e53716f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:53.230883 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-b41d94b7-1b44-4b7d-bcae-24d21e53716f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:53.259748 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b41d94b7-1b44-4b7d-bcae-24d21e53716f tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/b21e865b-b2b2-42e0-a618-41a22918d284" status: 200 len: 194 microversion: 2.1 time: 0.040326 Jun 27 15:14:53.260313 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1265/1515] 10.222.0.44 () {58 vars in 1412 bytes} [Mon Jun 27 15:14:53 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/b21e865b-b2b2-42e0-a618-41a22918d284 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:14:54.825346 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-74b4a41b-4819-44ad-a280-b78019344a15 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02291441-fd2f-44e7-8027-7f96329c2361"}} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:14:54.826400 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-74b4a41b-4819-44ad-a280-b78019344a15 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:14:54.833650 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74b4a41b-4819-44ad-a280-b78019344a15 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:54.834096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74b4a41b-4819-44ad-a280-b78019344a15 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:54.834842 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74b4a41b-4819-44ad-a280-b78019344a15 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:14:54.835276 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-74b4a41b-4819-44ad-a280-b78019344a15 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:14:55.586615 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-74b4a41b-4819-44ad-a280-b78019344a15 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "POST /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765049 Jun 27 15:14:55.587481 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1266/1516] 10.222.0.44 () {60 vars in 1322 bytes} [Mon Jun 27 15:14:54 2022] POST /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments => generated 194 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:15:04.138065 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-9013e5af-416e-465a-8e61-fa64dff52bc3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:04.139222 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-9013e5af-416e-465a-8e61-fa64dff52bc3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:04.146374 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9013e5af-416e-465a-8e61-fa64dff52bc3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:04.146824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9013e5af-416e-465a-8e61-fa64dff52bc3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:04.147601 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9013e5af-416e-465a-8e61-fa64dff52bc3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:04.148035 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-9013e5af-416e-465a-8e61-fa64dff52bc3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:04.179155 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-9013e5af-416e-465a-8e61-fa64dff52bc3 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046013 Jun 27 15:15:04.179729 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1267/1517] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:15:04 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:04.328295 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-fe035a3b-5927-42ca-ae68-f9de1e8bd929 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:04.328733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-fe035a3b-5927-42ca-ae68-f9de1e8bd929 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:04.334586 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe035a3b-5927-42ca-ae68-f9de1e8bd929 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:04.335028 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe035a3b-5927-42ca-ae68-f9de1e8bd929 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:04.335768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe035a3b-5927-42ca-ae68-f9de1e8bd929 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:04.336192 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-fe035a3b-5927-42ca-ae68-f9de1e8bd929 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:04.364142 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-fe035a3b-5927-42ca-ae68-f9de1e8bd929 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/b21e865b-b2b2-42e0-a618-41a22918d284" status: 200 len: 194 microversion: 2.1 time: 0.040025 Jun 27 15:15:04.364722 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1268/1518] 10.222.0.44 () {58 vars in 1412 bytes} [Mon Jun 27 15:15:04 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/b21e865b-b2b2-42e0-a618-41a22918d284 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:04.373462 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-80a7ed30-d73e-4446-b812-40a32ff74141 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:04.374637 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-80a7ed30-d73e-4446-b812-40a32ff74141 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:04.380196 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80a7ed30-d73e-4446-b812-40a32ff74141 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:04.380636 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80a7ed30-d73e-4446-b812-40a32ff74141 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:04.381406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80a7ed30-d73e-4446-b812-40a32ff74141 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:04.381826 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-80a7ed30-d73e-4446-b812-40a32ff74141 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:04.460140 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-80a7ed30-d73e-4446-b812-40a32ff74141 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lazy-loading 'services' on Instance uuid f98e00d5-16fa-43aa-a5cb-083e8040bef9 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:15:04.699239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-80a7ed30-d73e-4446-b812-40a32ff74141 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/b21e865b-b2b2-42e0-a618-41a22918d284" status: 202 len: 0 microversion: 2.1 time: 0.329066 Jun 27 15:15:04.699824 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1269/1519] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:15:04 2022] DELETE /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/b21e865b-b2b2-42e0-a618-41a22918d284 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:15:06.862123 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-eead161a-efa6-4bdf-a382-dfd01f4290f2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:06.862742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-eead161a-efa6-4bdf-a382-dfd01f4290f2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:06.868926 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eead161a-efa6-4bdf-a382-dfd01f4290f2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:06.869373 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eead161a-efa6-4bdf-a382-dfd01f4290f2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:06.870119 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eead161a-efa6-4bdf-a382-dfd01f4290f2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:06.870547 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-eead161a-efa6-4bdf-a382-dfd01f4290f2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:06.899147 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-eead161a-efa6-4bdf-a382-dfd01f4290f2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/02291441-fd2f-44e7-8027-7f96329c2361" status: 200 len: 194 microversion: 2.1 time: 0.042617 Jun 27 15:15:06.899728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1270/1520] 10.222.0.44 () {58 vars in 1412 bytes} [Mon Jun 27 15:15:06 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/02291441-fd2f-44e7-8027-7f96329c2361 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:06.909841 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3aec743e-c66e-4645-9d0e-db5646e43985 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:06.910358 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3aec743e-c66e-4645-9d0e-db5646e43985 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:06.916034 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3aec743e-c66e-4645-9d0e-db5646e43985 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:06.916479 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3aec743e-c66e-4645-9d0e-db5646e43985 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:06.917275 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3aec743e-c66e-4645-9d0e-db5646e43985 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:06.917710 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3aec743e-c66e-4645-9d0e-db5646e43985 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:06.996321 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-3aec743e-c66e-4645-9d0e-db5646e43985 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lazy-loading 'services' on Instance uuid f98e00d5-16fa-43aa-a5cb-083e8040bef9 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:15:07.219925 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3aec743e-c66e-4645-9d0e-db5646e43985 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/02291441-fd2f-44e7-8027-7f96329c2361" status: 202 len: 0 microversion: 2.1 time: 0.313801 Jun 27 15:15:07.220987 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1271/1521] 10.222.0.44 () {58 vars in 1415 bytes} [Mon Jun 27 15:15:06 2022] DELETE /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments/02291441-fd2f-44e7-8027-7f96329c2361 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:15:08.381411 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-33e0b263-1720-4f62-9d05-765778d2a4ee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:08.382447 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-33e0b263-1720-4f62-9d05-765778d2a4ee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:08.388541 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-33e0b263-1720-4f62-9d05-765778d2a4ee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:08.390089 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-33e0b263-1720-4f62-9d05-765778d2a4ee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:08.390571 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-33e0b263-1720-4f62-9d05-765778d2a4ee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:08.391017 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-33e0b263-1720-4f62-9d05-765778d2a4ee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:08.419698 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-33e0b263-1720-4f62-9d05-765778d2a4ee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042944 Jun 27 15:15:08.420239 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1272/1522] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:15:08 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:15:08.522945 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-f6842187-8193-432a-bd2a-1a8ba134ec68 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:08.523906 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-f6842187-8193-432a-bd2a-1a8ba134ec68 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:08.529819 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f6842187-8193-432a-bd2a-1a8ba134ec68 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:08.530273 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f6842187-8193-432a-bd2a-1a8ba134ec68 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:08.531023 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f6842187-8193-432a-bd2a-1a8ba134ec68 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:08.531435 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-f6842187-8193-432a-bd2a-1a8ba134ec68 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:08.558869 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-f6842187-8193-432a-bd2a-1a8ba134ec68 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039832 Jun 27 15:15:08.559405 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1273/1523] 10.222.0.44 () {58 vars in 1301 bytes} [Mon Jun 27 15:15:08 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:15:08.617795 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-78f021e3-3a85-492b-8e24-f650adb0c001 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:08.618294 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-78f021e3-3a85-492b-8e24-f650adb0c001 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:08.624953 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78f021e3-3a85-492b-8e24-f650adb0c001 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:08.625406 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78f021e3-3a85-492b-8e24-f650adb0c001 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:08.626158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78f021e3-3a85-492b-8e24-f650adb0c001 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:08.626591 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-78f021e3-3a85-492b-8e24-f650adb0c001 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:08.651740 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-78f021e3-3a85-492b-8e24-f650adb0c001 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Going to try to terminate instance {{(pid=129687) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:15:08.654569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:08.901878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-78f021e3-3a85-492b-8e24-f650adb0c001 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 204 len: 0 microversion: 2.1 time: 0.287677 Jun 27 15:15:08.902460 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1274/1524] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:15:08 2022] DELETE /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:15:08.911231 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-7c0f8875-b4a2-4b01-a405-46e69f45ef20 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:08.911971 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-7c0f8875-b4a2-4b01-a405-46e69f45ef20 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:08.917857 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7c0f8875-b4a2-4b01-a405-46e69f45ef20 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:08.918297 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7c0f8875-b4a2-4b01-a405-46e69f45ef20 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:08.919042 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7c0f8875-b4a2-4b01-a405-46e69f45ef20 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:08.919473 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-7c0f8875-b4a2-4b01-a405-46e69f45ef20 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:09.049978 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-7c0f8875-b4a2-4b01-a405-46e69f45ef20 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:15:09.057355 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-7c0f8875-b4a2-4b01-a405-46e69f45ef20 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1673 microversion: 2.1 time: 0.150218 Jun 27 15:15:09.057916 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1275/1525] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:15:08 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:15:10.074840 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-13eaeb45-86df-4234-8849-9275811a25d2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:10.075504 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-13eaeb45-86df-4234-8849-9275811a25d2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:10.082635 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13eaeb45-86df-4234-8849-9275811a25d2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:10.083078 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13eaeb45-86df-4234-8849-9275811a25d2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:10.083902 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13eaeb45-86df-4234-8849-9275811a25d2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:10.084339 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-13eaeb45-86df-4234-8849-9275811a25d2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:10.211357 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-13eaeb45-86df-4234-8849-9275811a25d2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:15:10.219068 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-13eaeb45-86df-4234-8849-9275811a25d2 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1673 microversion: 2.1 time: 0.148026 Jun 27 15:15:10.219634 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1276/1526] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:15:10 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:15:11.236811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-2f2eaf36-d47a-43d6-9681-ec8f9f72aca1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:11.237475 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-2f2eaf36-d47a-43d6-9681-ec8f9f72aca1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:11.243858 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f2eaf36-d47a-43d6-9681-ec8f9f72aca1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:11.244299 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f2eaf36-d47a-43d6-9681-ec8f9f72aca1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:11.245093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f2eaf36-d47a-43d6-9681-ec8f9f72aca1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:11.245517 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-2f2eaf36-d47a-43d6-9681-ec8f9f72aca1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:11.376933 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-2f2eaf36-d47a-43d6-9681-ec8f9f72aca1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:15:11.384340 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-2f2eaf36-d47a-43d6-9681-ec8f9f72aca1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1673 microversion: 2.1 time: 0.152243 Jun 27 15:15:11.384933 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1277/1527] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:15:11 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:15:12.025921 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [req-5aac5786-996f-4313-ad49-8bf3b396d1b2 req-56890427-937e-43ab-a773-47608b589b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98e00d5-16fa-43aa-a5cb-083e8040bef9", "name": "network-vif-deleted", "tag": "849c1c5d-922b-48ae-9d12-b1e316f69d97"}]} {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:15:12.034441 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5aac5786-996f-4313-ad49-8bf3b396d1b2 req-56890427-937e-43ab-a773-47608b589b27 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:12.034878 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [req-5aac5786-996f-4313-ad49-8bf3b396d1b2 req-56890427-937e-43ab-a773-47608b589b27 service nova] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:12.046319 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.compute.server_external_events [req-5aac5786-996f-4313-ad49-8bf3b396d1b2 req-56890427-937e-43ab-a773-47608b589b27 service nova] Creating event network-vif-deleted:849c1c5d-922b-48ae-9d12-b1e316f69d97 for instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 on hv-cinder-79760 Jun 27 15:15:12.051579 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [req-5aac5786-996f-4313-ad49-8bf3b396d1b2 req-56890427-937e-43ab-a773-47608b589b27 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029248 Jun 27 15:15:12.052171 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1278/1528] 10.222.0.44 () {64 vars in 1317 bytes} [Mon Jun 27 15:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:12.402261 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:12.402954 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:12.409908 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:12.411876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:12.411876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:12.411876 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:12.444051 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:12.444498 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:12.444969 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.objects.instance [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lazy-loading 'fault' on Instance uuid f98e00d5-16fa-43aa-a5cb-083e8040bef9 {{(pid=129687) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:15:12.489072 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.policy [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093402db51104953a681418b958b2c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa77b298448a40bbb2f12e1b5b9c5967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129687) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:15:12.496553 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-29fcb008-3bd4-40f3-bc21-f8067f1a7cee tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 200 len: 1327 microversion: 2.1 time: 0.099441 Jun 27 15:15:12.498598 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1279/1529] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:15:12 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:15:13.513309 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:13.513981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:13.520509 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:13.520981 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:13.521731 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:13.522164 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:13.535096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] HTTP exception thrown: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Request method failure captured: Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 HTTP/1.1 Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfdqZgZmXwYEFGoAIl8TguKRYlVreSElWffRvBtxZyRQpAiLPXNqSWYQJKY_BxDAGh9rC8SpxGLRaETZLfKzTHFh3B68L1tG8ydxa4c5bxY7h1yiUkkBcxYoEf4dCBMdO8_26d2ht7BRr7OrkqKN1g2AZsnfxvRHV8yn4zeW01Z4Zk Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:15:13.536811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 093402db51104953a681418b958b2c38 Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:13.538665 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'f98e00d5-16fa-43aa-a5cb-083e8040bef9'} Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:15:13.539965 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:13.541811 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:13.543336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Returning 404 to user: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:15:13.543336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-32fe43fb-e3b1-40c3-a1cd-6b37dac1c57e tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 404 len: 111 microversion: 2.1 time: 0.028731 Jun 27 15:15:13.543336 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1280/1530] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:15:13 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:15:13.547159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b5ee6d9f-51e3-4c6c-b86e-17f533ccd06c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '.version_select at 0x7f13f94e3040>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:13.626909 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b5ee6d9f-51e3-4c6c-b86e-17f533ccd06c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814274164" status: 202 len: 0 microversion: 2.1 time: 0.083893 Jun 27 15:15:13.627466 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1281/1531] 10.222.0.44 () {58 vars in 1220 bytes} [Mon Jun 27 15:15:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814274164 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:15:16.925672 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:16.926264 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:16.928712 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:16.933491 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:16.933932 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:16.934676 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:16.935102 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:16.948383 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] HTTP exception thrown: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Request method failure captured: Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 HTTP/1.1 Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfdqZgZmXwYEFGoAIl8TguKRYlVreSElWffRvBtxZyRQpAiLPXNqSWYQJKY_BxDAGh9rC8SpxGLRaETZLfKzTHFh3B68L1tG8ydxa4c5bxY7h1yiUkkBcxYoEf4dCBMdO8_26d2ht7BRr7OrkqKN1g2AZsnfxvRHV8yn4zeW01Z4Zk Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:15:16.950372 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 093402db51104953a681418b958b2c38 Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.952225 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'f98e00d5-16fa-43aa-a5cb-083e8040bef9'} Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:15:16.953235 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.954668 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.956156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Returning 404 to user: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:15:16.956156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-818cfe66-d99a-4ee4-a2b1-b5de3f7ab4a1 tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 404 len: 111 microversion: 2.1 time: 0.030937 Jun 27 15:15:16.956156 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1282/1532] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:15:16 2022] DELETE /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:15:16.959657 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:16.960250 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: f98e00d5-16fa-43aa-a5cb-083e8040bef9] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:16.966403 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:16.966899 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:16.968134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:16.968569 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:16.981626 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] HTTP exception thrown: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Request method failure captured: Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 HTTP/1.1 Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfdqZgZmXwYEFGoAIl8TguKRYlVreSElWffRvBtxZyRQpAiLPXNqSWYQJKY_BxDAGh9rC8SpxGLRaETZLfKzTHFh3B68L1tG8ydxa4c5bxY7h1yiUkkBcxYoEf4dCBMdO8_26d2ht7BRr7OrkqKN1g2AZsnfxvRHV8yn4zeW01Z4Zk Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:15:16.984278 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 093402db51104953a681418b958b2c38 Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.986083 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'f98e00d5-16fa-43aa-a5cb-083e8040bef9'} Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:15:16.987134 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. Jun 27 15:15:16.988775 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:16.990393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Returning 404 to user: Instance f98e00d5-16fa-43aa-a5cb-083e8040bef9 could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:15:16.990393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-75e17677-b65e-4ac5-b0e2-34b986b94c7a tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9" status: 404 len: 111 microversion: 2.1 time: 0.029557 Jun 27 15:15:16.990393 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1283/1533] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:15:16 2022] GET /compute/v2.1/servers/f98e00d5-16fa-43aa-a5cb-083e8040bef9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:15:18.274010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:18.274585 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:18.281701 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:18.294093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:18.294093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:18.294093 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:18.297334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] HTTP exception thrown: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Request method failure captured: Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: DELETE /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba HTTP/1.1 Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfdqZgZmXwYEFGoAIl8TguKRYlVreSElWffRvBtxZyRQpAiLPXNqSWYQJKY_BxDAGh9rC8SpxGLRaETZLfKzTHFh3B68L1tG8ydxa4c5bxY7h1yiUkkBcxYoEf4dCBMdO8_26d2ht7BRr7OrkqKN1g2AZsnfxvRHV8yn4zeW01Z4Zk Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:15:18.299021 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 093402db51104953a681418b958b2c38 Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.300888 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'da9fd2bf-be40-498e-94d5-8ea8e588bcba'} Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:15:18.302160 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.304152 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.305825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Returning 404 to user: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:15:18.305825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3a038b9a-602f-4ef3-8c7b-2554480519cc tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "DELETE /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 404 len: 111 microversion: 2.1 time: 0.030673 Jun 27 15:15:18.305825 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1284/1534] 10.222.0.44 () {58 vars in 1238 bytes} [Mon Jun 27 15:15:18 2022] DELETE /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:15:18.308100 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Calling method '>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:18.308708 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.compute.api [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] [instance: da9fd2bf-be40-498e-94d5-8ea8e588bcba] Fetching instance by UUID {{(pid=129687) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:15:18.314508 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:18.314988 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:18.315733 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:15:18.316158 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG oslo_concurrency.lockutils [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Lock "d98c4119-3b5c-4544-98c3-1189517bc4f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:15:18.331159 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.wsgi [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] HTTP exception thrown: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Request method failure captured: Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: request: GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba HTTP/1.1 Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept: application/json Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Accept-Encoding: identity Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Connection: close Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Length: 0 Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Content-Type: application/json Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Host: 10.222.0.44 Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Openstack-System-Scope: None Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: User-Agent: python-urllib3/1.26.9 Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Auth-Token: gAAAAABiucfdqZgZmXwYEFGoAIl8TguKRYlVreSElWffRvBtxZyRQpAiLPXNqSWYQJKY_BxDAGh9rC8SpxGLRaETZLfKzTHFh3B68L1tG8ydxa4c5bxY7h1yiUkkBcxYoEf4dCBMdO8_26d2ht7BRr7OrkqKN1g2AZsnfxvRHV8yn4zeW01Z4Zk Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Id: None Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Domain-Name: None Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Identity-Status: Confirmed Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Is-Admin-Project: True Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Id: default Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Domain-Name: Default Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Project-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Role: member,reader Jun 27 15:15:18.332667 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Roles: member,reader Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa77b298448a40bbb2f12e1b5b9c5967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Id: fa77b298448a40bbb2f12e1b5b9c5967 Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8866637 Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Id: default Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Domain-Name: Default Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Id: 093402db51104953a681418b958b2c38 Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: X-User-Name: tempest-AttachVolumeTestJSON-8866637-project Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: method: > Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: exception: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.334410 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: action_args: {'id': 'da9fd2bf-be40-498e-94d5-8ea8e588bcba'} Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:15:18.335613 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. Jun 27 15:15:18.337334 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: ERROR nova.api.openstack.wsgi Jun 27 15:15:18.339029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] Returning 404 to user: Instance da9fd2bf-be40-498e-94d5-8ea8e588bcba could not be found. {{(pid=129687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:15:18.339029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-6faa8faa-0b1b-4b51-b652-72e8c46a581c tempest-AttachVolumeTestJSON-8866637 tempest-AttachVolumeTestJSON-8866637-project] 10.222.0.44 "GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba" status: 404 len: 111 microversion: 2.1 time: 0.029373 Jun 27 15:15:18.339029 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1285/1535] 10.222.0.44 () {58 vars in 1235 bytes} [Mon Jun 27 15:15:18 2022] GET /compute/v2.1/servers/da9fd2bf-be40-498e-94d5-8ea8e588bcba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:15:25.374555 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-25c8e2ce-bdc3-4946-bb18-370be1a3d77f tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13f9451ca0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:25.422430 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-25c8e2ce-bdc3-4946-bb18-370be1a3d77f tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/5d29c76a-6ed9-4b35-989f-667a6400369d" status: 200 len: 351 microversion: 2.1 time: 0.051663 Jun 27 15:15:25.423049 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1286/1536] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:15:25 2022] GET /compute/v2.1/os-volumes/5d29c76a-6ed9-4b35-989f-667a6400369d => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:27.002391 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d5b0895b-016f-4518-9420-6b1ad08a0077 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13fe2844c0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:27.049556 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d5b0895b-016f-4518-9420-6b1ad08a0077 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ffd3aba3-8dee-4f50-83a3-5d04b8e22437" status: 200 len: 350 microversion: 2.1 time: 0.051473 Jun 27 15:15:27.050120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1287/1537] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:15:26 2022] GET /compute/v2.1/os-volumes/ffd3aba3-8dee-4f50-83a3-5d04b8e22437 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:28.622539 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:28.623820 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG dbcounter [-] [129687] Writing DB stats nova_api:SELECT=7 {{(pid=129687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:28.627721 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-bb051bbd-be78-4279-b98f-3d819a413f0c tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13f9443d30>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:28.676180 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-bb051bbd-be78-4279-b98f-3d819a413f0c tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/8f73ce99-30a3-436a-9cf6-b5c73d2ccf88" status: 200 len: 351 microversion: 2.1 time: 0.054715 Jun 27 15:15:28.676773 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1288/1538] 10.222.0.44 () {58 vars in 1244 bytes} [Mon Jun 27 15:15:28 2022] GET /compute/v2.1/os-volumes/8f73ce99-30a3-436a-9cf6-b5c73d2ccf88 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:28.688482 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-b0279107-7186-4ba8-8fcd-7927101954a9 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13fe2844c0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:28.770154 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-b0279107-7186-4ba8-8fcd-7927101954a9 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086213 Jun 27 15:15:28.770728 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1289/1539] 10.222.0.44 () {58 vars in 1133 bytes} [Mon Jun 27 15:15:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:15:28.782485 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-3ea97eb7-4ffe-49c2-bb83-6f9dfa23ccae tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13f969d4c0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:28.862756 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-3ea97eb7-4ffe-49c2-bb83-6f9dfa23ccae tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083910 Jun 27 15:15:28.863356 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1290/1540] 10.222.0.44 () {58 vars in 1148 bytes} [Mon Jun 27 15:15:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:28.875206 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-4ea3d113-15ca-40ca-a081-dfef09463cf4 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13f94e3ca0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:28.956536 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-4ea3d113-15ca-40ca-a081-dfef09463cf4 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085353 Jun 27 15:15:28.957148 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1291/1541] 10.222.0.44 () {58 vars in 1133 bytes} [Mon Jun 27 15:15:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:15:28.967768 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-57def71b-d4bb-4136-a24f-50803b0654eb tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13fe229dc0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:29.047501 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-57def71b-d4bb-4136-a24f-50803b0654eb tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083136 Jun 27 15:15:29.048062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1292/1542] 10.222.0.44 () {58 vars in 1166 bytes} [Mon Jun 27 15:15:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:29.059120 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-21be1cdc-db44-4467-91ad-221310129227 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13f94510d0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:29.138344 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-21be1cdc-db44-4467-91ad-221310129227 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082644 Jun 27 15:15:29.139062 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1293/1543] 10.222.0.44 () {58 vars in 1169 bytes} [Mon Jun 27 15:15:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:29.150285 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-5db54ec5-6a7b-4a3b-9b36-2e50ee7efc3d tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13fe284dc0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:29.229143 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-5db54ec5-6a7b-4a3b-9b36-2e50ee7efc3d tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082202 Jun 27 15:15:29.229727 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1294/1544] 10.222.0.44 () {58 vars in 1154 bytes} [Mon Jun 27 15:15:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:15:29.240882 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-e973b5e1-c3ff-4221-b6ff-0a1b2a33beb2 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13f94d41f0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:29.319514 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-e973b5e1-c3ff-4221-b6ff-0a1b2a33beb2 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081989 Jun 27 15:15:29.320096 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1295/1545] 10.222.0.44 () {58 vars in 1187 bytes} [Mon Jun 27 15:15:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:15:29.331577 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: DEBUG nova.api.openstack.wsgi [None req-d24e402c-eb50-4089-9b6b-bec55c1a18e9 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] Calling method '.version_select at 0x7f13f969d4c0>' {{(pid=129687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:15:29.411188 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO nova.api.openstack.requestlog [None req-d24e402c-eb50-4089-9b6b-bec55c1a18e9 tempest-VolumesTestJSON-1894348821 tempest-VolumesTestJSON-1894348821-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083013 Jun 27 15:15:29.411957 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: [pid: 129687|app: 0|req: 1296/1546] 10.222.0.44 () {58 vars in 1154 bytes} [Mon Jun 27 15:15:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:16:01.787002 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:16:01.787774 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Mon Jun 27 15:16:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:17:58.951144 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:17:58.951865 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Mon Jun 27 15:17:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:19:21.794940 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:19:21.795625 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Mon Jun 27 15:19:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:20:52.281113 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:20:52.281760 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Mon Jun 27 15:20:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:21:18.959010 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:21:18.959742 dv-cinder-797608-35-iscsi devstack@n-api.service[129687]: Mon Jun 27 15:21:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!